Heterogeneous system for HMI program monitoring and HMI program monitoring method

Abstract

The present invention provides a heterogeneous system and method for monitoring HMI programs. The heterogeneous system includes a main processor and a coprocessor. The main processor is installed with an HMI program and a sysmgr program. The HMI program is responsible for displaying 3D images. The coprocessor is installed with a screen drawing driver, main-app, responsible for displaying 2D images. By enabling the drawing driver on one core of the heterogeneous system to monitor the HMI application on another core, the present invention not only mitigates the risk of display failure caused by an HMI program anomaly, but also mitigates the risk of display failure caused by system environment anomalies during HMI program execution. This significantly improves the robustness of the HMI program's automatic repair function after anomalies occur, while also reducing the safety risks associated with instrument screen display failure during vehicle operation.

Description

Technical Field

[0001] The present invention relates to the field of monitoring when a program is abnormal, and more particularly to a heterogeneous system for HMI program monitoring and an HMI program monitoring method. Background Art

[0002] With the development of intelligent vehicles, traditional mechanical instruments are no longer able to meet consumer demand. Full LCD instrument clusters, featuring richer display content, layered design, beautiful appearance, and a strong overall appearance, are the future trend. Full LCD instrument clusters can display a wealth of information, including vehicle battery level, voltage, energy distribution, and map navigation, all of which are not available in traditional mechanical instruments. With the penetration of new energy vehicles and advanced intelligent driving, the use of full LCD instrument clusters is also increasing.

[0003] However, while full LCD instrument clusters offer richer and more beautiful display content, their stability is somewhat inferior to that of traditional mechanical instruments. For example, while driving, the 3D instrument cluster screen may suddenly go black and fail to display properly. Therefore, it is necessary to provide a technical solution to address this technical issue. Summary of the Invention

[0004] The present invention aims to solve the technical problems existing in the prior art and provides a heterogeneous system for HMI program monitoring and an HMI program monitoring method.

[0005] According to a first aspect of the present invention, a heterogeneous system for HMI program monitoring is provided, comprising a main processor and a coprocessor, wherein the main processor is installed with an HMI program and a sysmgr program, the HMI program being responsible for displaying 3D images, and the coprocessor is installed with a screen drawing driver program main-app being responsible for displaying 2D images;

[0006] The HMI program is configured to send heartbeat information to the main-app of the coprocessor at a first fixed period, wherein the heartbeat information reflects whether the 3D image is abnormal;

[0007] The main-app is configured to receive heartbeat information sent by the HMI program according to a second fixed period, and when the heartbeat information times out, send a restart signal to the sysmgr program on the main processor;

[0008] The sysmgr program is used to restart the HMI program based on the restart signal.

[0009] On the basis of the above technical solution, the present invention can also make the following improvements.

[0010] Optionally, the 2D image includes vehicle speed information, mileage information, warning information and vehicle speed information, and the 3D image includes the instrument's startup screen, screen switching, setting interface rendering and map display.

[0011] Optionally, the HMI program is configured to send heartbeat information to the main-app of the coprocessor at a first fixed period, wherein the heartbeat information reflects whether the 3D image is abnormal, including:

[0012] According to the refresh rate of the current screen, the HMI program sends the heartbeat information to the main-app of the coprocessor through the first inter-core communication channel according to the first fixed period.

[0013] Optionally, the main-app is configured to receive heartbeat information sent by the HMI program according to a second fixed period, and when the heartbeat information times out, send a restart signal to the sysmgr program on the main processor, including:

[0014] The main-app receives the heartbeat information sent by the HMI program according to the second fixed period, determines whether the heartbeat information has timed out, and if so, sends a restart signal to the sysmgr program on the main processor through the second inter-core communication channel, where the first fixed period is greater than the second fixed period.

[0015] Optionally, determining whether the heartbeat information has timed out includes:

[0016] When the main-app does not receive the heartbeat information within a set time threshold, it is determined that the heartbeat information has timed out, indicating that the HMI program is abnormal.

[0017] Optionally, the sysmgr program is used to restart the HMI program based on the restart signal, including:

[0018] When the sysmgr program receives the restart signal, it reclaims the resources of the HMI program and starts the HMI program. After the start-up operation is completed, it determines whether the start-up of the HMI program is successful.

[0019] If the pull-up is successful and in line with expectations, no action will be taken;

[0020] If the startup fails for multiple times, the main processor is triggered to restart. After the main processor restarts, the sysmgr program automatically starts the HMI program and restarts the HMI program.

[0021] According to a second aspect of the present invention, there is provided an HMI program monitoring method, comprising:

[0022] The HMI program sends heartbeat information to the main-app of the coprocessor at a first fixed period, wherein the heartbeat information reflects whether the 3D image is abnormal;

[0023] The main-app receives the heartbeat information sent by the HMI program according to a second fixed period, and when the heartbeat information times out, sends a restart signal to the sysmgr program on the main processor;

[0024] The sysmgr program restarts the HMI program based on the restart signal.

[0025] The present invention provides a heterogeneous system and HMI program monitoring method. In a heterogeneous system, a drawing driver on one core monitors an HMI application on another core. This method not only prevents the risk of the HMI program itself failing to display due to abnormalities, but also prevents the risk of the HMI program failing to display normally due to abnormalities in the system environment when the HMI program is running. This greatly improves the robustness of the automatic repair function after an HMI program failure, and also reduces the related safety risks caused by the instrument screen failing to display normally during vehicle operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 A schematic diagram of the structure of a heterogeneous system for HMI program monitoring provided by the present invention;

[0027] Figure 2 A flow chart showing the process of monitoring HMI programs based on heterogeneous systems;

[0028] Figure 3 This is a flowchart for restarting the HMI program;

[0029] Figure 4 This is a flow chart of an HMI program monitoring method provided by the present invention. DETAILED DESCRIPTION

[0030] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention. In addition, the technical features in the various embodiments or single embodiments provided by the present invention can be arbitrarily combined with each other to form a feasible technical solution. This combination is not restricted by the sequence of steps and / or structural composition mode, but must be based on the ability of ordinary technicians in this field to implement it. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0031] Figure 1 A schematic diagram of a heterogeneous system structure for HMI program monitoring of the present invention is provided, such as Figure 1 As shown, the heterogeneous system includes a main processor and a coprocessor. The main processor is installed with an HMI program and a sysmgr program. The HMI program is responsible for displaying 3D images. The coprocessor is installed with a screen drawing driver main-app, which is responsible for displaying 2D images.

[0032] The HMI program is configured to send heartbeat information to the main-app of the coprocessor at a first fixed period, wherein the heartbeat information reflects whether the 3D image is abnormal; the main-app is configured to receive the heartbeat information sent by the HMI program at a second fixed period, and when the heartbeat information times out, send a restart signal to the sysmgr program on the main processor; and the sysmgr program is configured to restart the HMI program based on the restart signal.

[0033] It is understood that the heterogeneous system provided by the present invention includes a main processor CA53 and a coprocessor CR7. The main processor is installed with the HMI program and the sysmgr program, and the coprocessor is installed with the main-app. The main processor CA53 is a cortex-A53, responsible for displaying 3D images, and the coprocessor CR7 is a cortex-R7, responsible for displaying 2D images. The image rendering driver runs on the CR7 core side. In other words, after the 3D and 2D images are merged, the fused image is displayed on the screen, and this function is completed by the CR7 core.

[0034] The CR7 core side runs an RTOS system, which is responsible for the high-real-time 2D screen display; the 2D screen includes vehicle speed information, mileage information, warning information, vehicle speed information, etc.

[0035] The AGL system runs on the core side of CA53, which is responsible for displaying the 3D images of the entire instrument. The 3D images include the instrument's startup screen, screen switching, setting interface rendering, map display, etc.; however, the display of the 3D images also needs to rely on the screen drawing driver running on the CR7 side; the startup sequence of the entire system is that the RTOS on the CR7 side starts first, and then the AGL system on the CA53 side starts.

[0036] When an HMI program is abnormal, the 3D screen will not be displayed normally. Therefore, it is necessary to monitor and repair the abnormality of the HMI program. For specific implementation of monitoring the HMI program, please refer to Figure 2 , an HMI program is used to send heartbeat information to the main-app of the coprocessor at a first fixed period; the main-app is used to receive the heartbeat information sent by the HMI program at a second fixed period. When the heartbeat information times out, it indicates that an abnormality has occurred in the HMI program, and a restart signal is sent to the sysmgr program on the main processor; the sysmgr program is used to restart the HMI program based on the restart signal.

[0037] As an embodiment, the HMI program is used to send heartbeat information to the main-app of the coprocessor at a first fixed period, and the heartbeat information reflects whether the 3D picture is abnormal, including: according to the refresh rate of the current picture, the HMI program sends the heartbeat information to the main-app of the coprocessor through the first inter-core communication channel according to the first fixed period.

[0038] It can be understood that the HMI program is the main program for displaying 3D images. It will send heartbeat information to the CR7 core side at a certain period T0 based on the refresh rate of the current image. The heartbeat information of the HMI program is essentially the screen drawing synchronization signal sent by the CA53 core side to the CR7 core side, so this heartbeat information can directly reflect whether the image is abnormal.

[0039] The main_app on the CR7 side obtains the heartbeat information sent by the HMI program in real time through the inter-core communication channel, and the main_app will make a decision on the heartbeat information.

[0040] Among them, in the present invention, main_app refers to the RTOS main program running on the CR7 core. This program is mainly responsible for fusing the 3D image and the 2D image and displaying the fused image on the screen.

[0041] The inter-core communication channel is a fixed memory area implemented based on shared memory. This memory area is designed into several blocks according to functional requirements, and the heartbeat information of the 3D image is stored in a specified area of ​​a certain content.

[0042] As an embodiment, the main-app is used to receive the heartbeat information sent by the HMI program according to a second fixed period, and when the heartbeat information times out, send a restart signal to the sysmgr program on the main processor, including: the main-app receives the heartbeat information sent by the HMI program according to the second fixed period, determines whether the heartbeat information times out, and if so, sends a restart signal to the sysmgr program on the main processor through the second inter-core communication channel, and the first fixed period is greater than the second fixed period.

[0043] It's understood that the main_app on the CR7 core receives the HMI program's heartbeat information and internally determines whether a timeout has occurred. If so, it immediately sends a restart signal to the CA53 core via the inter-core communication channel. The internal determination of a timeout refers to the main_app receiving heartbeat information at a fixed period, T1 (us). This period is related to the heartbeat information transmission period from the main processor to the coprocessor in the following relationship: T0 (us) > 2T1 (us). For example, if no heartbeat information is received within 2 (s), the heartbeat information is considered to have timed out, indicating that the HMI program has failed and requires a restart. Therefore, the main-app sends a restart signal to the main processor's sysmgr program.

[0044] Among them, sending the restart signal means that the main_app program writes a flag to the CA53 core through the inter-core communication channel. The default value of this flag is 0. When the heartbeat information timeout occurs, the CR7 core will write it to 1 and will not actively clear this flag to 0; instead, the CA53 side will actively read 1 and immediately clear it to 0. At this time, it can be considered that the restart signal CA53 has been received and the next timeout count can be performed.

[0045] It should be noted that the inter-core communication channel used when the main-app program sends a restart signal to the sysmgr program is different from the inter-core communication channel used when the HMI program sends heartbeat information to the main-app program. That is, the shared memory areas are different and relatively independent.

[0046] As an embodiment, the sysmgr program is used to restart the HMI program based on the restart signal, including: when the sysmgr program obtains the restart signal, it recycles the resources of the HMI program and pulls up the HMI program. After the pull-up operation is completed, it judges whether the pulling up of the HMI program is successful; if the pulling up is successful, no processing is performed; if the pulling up fails for multiple consecutive times, the main processor is triggered to restart automatically. After the main processor restarts, the sysmgr program automatically pulls up the HMI program to complete the restart of the HMI program.

[0047] It can be understood that the sysmgr application on the CA53 side obtains the restart signal. In the present invention, the sysmgr program is an application running on the AGL system. If it needs to obtain the content of inter-core communication, the data needs to be passed through the driver layer to the service layer, and the service layer is passed to the application layer.

[0048] The sysmgr program is responsible for managing apps in the CA53's application layer, including but not limited to app termination and restart, app resource recovery, app startup order, and app startup priority. The sysmgr program periodically receives a restart signal from the service layer, and sysmgr determines whether it is the first time it has received a restart signal since power-up.

[0049] When the sysmgr program receives the restart signal, it restarts the HMI program. For the restart process, see Figure 3 When the sysmgr program receives the restart signal, it will first recycle the HMI resources. After the resources are successfully recycled, the HMI program will be started. After the start-up operation is completed, it will determine whether the HMI program is successfully started.

[0050] If the startup fails three times in a row, it means that the system environment required by the HMI program has been damaged when it was started, and the HMI program cannot be restarted. At this time, sysmgr will trigger the CA53 core to restart automatically. After the CA53 restarts, it is equivalent to system recovery. The sysmgr program will automatically start the HMI program to ensure normal drawing of the 3D screen.

[0051] See also Figure 4 , an HMI program monitoring method provided by the present invention mainly includes the following steps:

[0052] S1, the HMI program sends heartbeat information to the main-app of the coprocessor at a first fixed period, wherein the heartbeat information reflects whether the 3D image is abnormal.

[0053] S2, main-app receives heartbeat information sent by the HMI program according to a second fixed period, and when the heartbeat information times out, sends a restart signal to the sysmgr program on the main processor.

[0054] As an embodiment, the main-app receives the heartbeat information sent by the HMI program according to a second fixed period, and when the heartbeat information times out, sends a restart signal to the sysmgr program on the main processor, including: the main-app receives the heartbeat information sent by the HMI program according to the second fixed period, determines whether the heartbeat information times out, and if so, sends a restart signal to the sysmgr program on the main processor through the second inter-core communication channel, and the first fixed period is greater than the second fixed period.

[0055] S3, the sysmgr program restarts the HMI program based on the restart signal.

[0056] As an embodiment, the sysmgr program restarts the HMI program based on the restart signal, including: when the sysmgr program obtains the restart signal, it recycles the resources of the HMI program and pulls up the HMI program. After the pull-up operation is completed, it determines whether the pulling up of the HMI program is successful; if the pulling up is successful, it is in line with expectations and no processing is performed; if the pulling up fails for multiple consecutive times, the main processor is triggered to restart automatically. After the main processor restarts, the sysmgr program automatically pulls up the HMI program and restarts the HMI program.

[0057] It can be understood that the HMI program monitoring method provided by the present invention corresponds to the heterogeneous system for HMI program monitoring provided by the aforementioned embodiments. The relevant technical features of the HMI program monitoring method can refer to the relevant technical features of the heterogeneous system for HMI program monitoring, which will not be repeated here.

[0058] Embodiments of the present invention provide a heterogeneous system and HMI program monitoring method for HMI program monitoring. In a heterogeneous system, a drawing driver on one core monitors an HMI application on another core. This not only mitigates the risk of the HMI program failing to display due to anomalies, but also mitigates the risk of the HMI program failing to display normally due to system environment anomalies while the HMI program is running. This significantly improves the robustness of the automatic repair function after an HMI program failure, while also mitigating safety risks associated with the instrument screen failing to display normally while the vehicle is in motion.

[0059] It should be noted that, in the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0060] It will be understood by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Thus, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0061] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowcharts and / or block diagrams, as well as combinations of processes and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowcharts and / or block diagrams. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0062] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0063] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 The steps for the function specified in one or more boxes.

[0064] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0065] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if such changes and modifications fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.

Claims

1. A heterogeneous system for HMI program monitoring, characterized in that: The system includes a main processor and a coprocessor. The main processor is installed with an HMI program and a sysmgr program. The HMI program is responsible for displaying 3D images. The coprocessor is installed with a screen drawing driver main-app, which is responsible for displaying 2D images. The HMI program is configured to send heartbeat information to the main-app of the coprocessor at a first fixed period, wherein the heartbeat information reflects whether the 3D image is abnormal; The main-app is configured to receive heartbeat information sent by the HMI program according to a second fixed period, and when the heartbeat information times out, send a restart signal to the sysmgr program on the main processor; The sysmgr program is used to restart the HMI program based on the restart signal; The sysmgr program is used to restart the HMI program based on the restart signal, including: When the sysmgr program receives the restart signal, it reclaims the resources of the HMI program and starts the HMI program. After the start-up operation is completed, it determines whether the start-up of the HMI program is successful. If the pull-up succeeds and meets expectations, no further processing is required; If the startup fails for multiple times, the main processor is triggered to restart. After the main processor restarts, the sysmgr program automatically starts the HMI program and restarts the HMI program.

2. The heterogeneous system according to claim 1, characterized in that: The 2D image includes vehicle speed information, mileage information, warning information and vehicle speed information, and the 3D image includes the instrument's startup screen, screen switching, setting interface rendering and map display.

3. The heterogeneous system according to claim 1, characterized in that: The HMI program is configured to send heartbeat information to the main-app of the coprocessor at a first fixed period, wherein the heartbeat information reflects whether the 3D image is abnormal, including: According to the refresh rate of the current screen, the HMI program sends the heartbeat information to the main-app of the coprocessor through the first inter-core communication channel according to the first fixed period.

4. The heterogeneous system according to claim 1, characterized in that: The main-app is configured to receive heartbeat information sent by the HMI program according to a second fixed period, and when the heartbeat information times out, send a restart signal to the sysmgr program on the main processor, including: The main-app receives the heartbeat information sent by the HMI program according to the second fixed period, determines whether the heartbeat information has timed out, and if so, sends a restart signal to the sysmgr program on the main processor through the second inter-core communication channel, where the first fixed period is greater than the second fixed period.

5. The heterogeneous system according to claim 4, characterized in that: Determining whether the heartbeat information has timed out includes: When the main-app does not receive the heartbeat information within a set time threshold, it is determined that the heartbeat information has timed out, indicating that the HMI program is abnormal.

6. A method for monitoring HMI programs based on heterogeneous systems, characterized in that: The heterogeneous system includes a main processor and a coprocessor, wherein an HMI program and a sysmgr program are installed on the main processor, wherein the HMI program is responsible for displaying 3D images, and a screen drawing driver program main-app is installed on the coprocessor, which is responsible for displaying 2D images. The method includes: The HMI program sends heartbeat information to the main-app of the coprocessor at a first fixed period, wherein the heartbeat information reflects whether the 3D image is abnormal; The main-app receives the heartbeat information sent by the HMI program according to a second fixed period, and when the heartbeat information times out, sends a restart signal to the sysmgr program on the main processor; The sysmgr program restarts the HMI program based on the restart signal; The sysmgr program restarts the HMI program based on the restart signal, including: When the sysmgr program receives the restart signal, it reclaims the resources of the HMI program and starts the HMI program. After the start-up operation is completed, it determines whether the start-up of the HMI program is successful. If the pull-up succeeds and meets expectations, no action is taken; If the startup fails for multiple times, the main processor is triggered to restart. After the main processor restarts, the sysmgr program automatically starts the HMI program and restarts the HMI program.

7. The HMI program monitoring method according to claim 6, characterized in that: The main-app receives the heartbeat information sent by the HMI program according to a second fixed period, and when the heartbeat information times out, sends a restart signal to the sysmgr program on the main processor, including: The main-app receives the heartbeat information sent by the HMI program according to the second fixed period, determines whether the heartbeat information has timed out, and if so, sends a restart signal to the sysmgr program on the main processor through the second inter-core communication channel, where the first fixed period is greater than the second fixed period.

Images