Fault diagnosis system, vehicle, fault diagnosis method and surround view controller

Abstract

This invention provides a fault diagnosis system, vehicle, fault diagnosis method, and surround view controller, relating to the field of fault diagnosis technology. The system includes a controller and a display device. The controller includes an embedded graphical interface system and a video output interface. The display device is connected to the video output interface. The controller is used to obtain target data characterizing whether the controller is faulty based on its operating data, and to draw a display interface based on the target data using the embedded graphical interface system. The display interface is transmitted to the display device for display via the video output interface. The target data includes the fault diagnosis results of the controller. This system enables self-diagnosis of the controller and displays a visual interface characterizing whether the controller is faulty, providing good visibility.

Description

Technical Field

[0001] This invention relates to the field of fault diagnosis technology, and in particular to a fault diagnosis system, vehicle, fault diagnosis method and surround view controller. Background Technology

[0002] As a key component of equipment, the controller controls the normal operation of the equipment. For example, in the automotive field, controllers include various types such as vehicle controllers, engine controllers, motor controllers, and surround view controllers. The working status of the controller is related to the operation of the entire equipment. Therefore, it is necessary to diagnose controller faults.

[0003] Controllers are typically located inside their respective devices, which makes troubleshooting and diagnosis difficult. Currently, most technologies involve adding external diagnostic equipment to the controller to diagnose faults. However, this approach not only increases the overall load on the equipment and costs but also fails to provide users with a real-time and intuitive view of the controller's operating status, resulting in poor visibility. Summary of the Invention

[0004] In view of this, the purpose of this invention is to provide a fault diagnosis system, vehicle, fault diagnosis method and surround view controller, which can specifically solve existing problems.

[0005] Based on the above objectives, in a first aspect, the present invention proposes a fault diagnosis system, the system comprising: a controller and a display device; the controller including an embedded graphical interface system and a video output interface; the display device connected to the video output interface; the controller being configured to obtain target data characterizing whether the controller is faulty based on the controller's operating data, and to draw a display interface based on the target data through the embedded graphical interface system; and to transmit the display interface to the display device for display through the video output interface; wherein the target data includes the fault diagnosis results of the controller.

[0006] Optionally, the controller is configured to determine the fault diagnosis result of the controller based on the controller's operating data; the fault diagnosis result of the controller includes at least one of the following: device temperature, CPU utilization, camera status, surround view function status, CAN status, system status, and recording status, wherein the device temperature represents the temperature of the controller, the CPU utilization represents the resource utilization of the controller, the camera status represents the connection status of the data transmission channel between the controller and the camera, the surround view function status represents whether the controller can generate a complete top view, the CAN status represents the communication line connection status between the controller and the central control screen, the system status represents whether the fault diagnosis system itself has abnormal signals, and the recording status represents whether the camera's video data is normally written to the storage module.

[0007] Optionally, the controller and the display device are further connected via a communication line; the display device also includes an external export interface; the controller is further configured to transmit the target data to the display device via the communication line; the display device is further configured to export the target data via the external export interface.

[0008] Optionally, the display device further includes a network transmission module, and the system further includes a server; the display device communicates with the server through the network transmission module; the display device is used to transmit the target data to the server through the network transmission module; the controller further includes a wireless communication module, the display device includes a user terminal, and the controller is further used to send the display interface to the user terminal through the wireless communication module.

[0009] Optionally, the system further includes an input device, and the controller further includes a data acquisition interface; the input device is connected to the data acquisition interface; the controller is also configured to receive external data input by the input device through the data acquisition interface, and the controller's operating data includes the external data.

[0010] Optionally, the controller includes a surround view controller for the vehicle, and the display device includes the central control screen of the vehicle; the surround view controller is used to obtain target data for characterizing whether the surround view controller is malfunctioning based on its own internal data during operation and video data input from an external image acquisition device connected to the surround view controller, and to draw a display interface based on the target data; and to transmit the display interface to the central control screen for display.

[0011] Secondly, a vehicle is also provided, including the fault diagnosis system described in any one of the first aspects.

[0012] Thirdly, a fault diagnosis method is also provided, applied to the fault diagnosis system described in any one of the first aspects, the method comprising: obtaining target data for characterizing whether the controller is faulty based on the controller's operating data; drawing a display interface based on the target data; the target data including the fault diagnosis results of the controller; and transmitting the display interface to a display device for display.

[0013] Optionally, obtaining target data to characterize whether the controller is faulty based on the controller's operating data includes: performing fault analysis on the controller based on the controller's own internal data and external data input from external input devices connected to the controller, obtaining fault diagnosis results, and using the fault diagnosis results as the target data; the fault diagnosis results include one or more diagnostic results for the controller's temperature, resource utilization rate, and data transmission interface connection status with the external input devices.

[0014] Optionally, the controller includes a surround view controller, and the controller's internal data includes a splicing parameter table, which is obtained based on the surround view controller's parameter calibration of external input devices. Fault analysis is performed on the controller to obtain fault diagnosis results, including: detecting identification information in the splicing parameter table at each startup time of the surround view controller, wherein the identification information is obtained based on the complete splicing parameter table generated when the surround view controller calibrates the external input devices; if the identification information is detected, the splicing parameter table is determined to be normal; if the identification information is not detected, the splicing parameter table is determined to be abnormal.

[0015] Optionally, the target data further includes the controller's operation log information. Obtaining target data to characterize whether the controller is faulty based on the controller's operation data includes: recording the controller's operation log information in real time during the process of the controller running the program based on the operation data; and marking an abnormality in the operation log information corresponding to the abnormal program by marking an abnormality identifier during the recording of the operation log information.

[0016] Optionally, drawing a display interface based on the target data includes: drawing a fault diagnosis interface of the controller through an embedded graphical interface system in the controller based on the fault diagnosis results, and using the fault diagnosis interface as the display interface.

[0017] Optionally, drawing a display interface based on the target data includes: drawing a log viewing interface of the controller through an embedded graphical interface system in the controller based on the operation log information, and using the log viewing interface as the display interface.

[0018] Optionally, the method further includes: drawing the log viewing interface through the embedded graphical interface system at preset intervals, and / or receiving a log viewing instruction transmitted by the display device, and drawing the log viewing interface through the embedded graphical interface system in response to the user's log viewing instruction.

[0019] Optionally, the method further includes: transmitting the target data to the display device based on a preset encapsulation protocol; wherein the preset encapsulation protocol includes any one of bitwise byte private protocol, JSON, and XML.

[0020] Optionally, the method further includes: sending the target data to a server via the display device, and / or exporting the target data via an external export interface on the display device.

[0021] Fourthly, a surround view controller is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that the processor executes the computer program to implement the method described in the third aspect.

[0022] Fifthly, a computer-readable storage medium is also provided, having a computer program stored thereon, the program being executed by a processor to implement the method described in any of the third aspects.

[0023] In summary, the present invention has at least the following beneficial effects:

[0024] The fault diagnosis system provided in this invention obtains target data to characterize whether the controller is faulty based on the controller's operating data. It can perform fault diagnosis on the controller itself. The controller draws a display interface based on the target data through an embedded graphical interface system and transmits the display interface to a display device for display through a video output interface. The target data includes the controller's fault diagnosis results. Since the display interface is drawn based on the target data, it also includes the controller's fault diagnosis results. The system can intuitively display the diagnosis results of whether the controller is faulty to the user, providing good visibility. Attached Figure Description

[0025] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the various drawings denote the same or similar parts or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings depict only some embodiments disclosed in the invention and should not be construed as limiting the scope of the invention.

[0026] Figure 1 A schematic diagram of a fault diagnosis system according to an embodiment of the present invention is shown;

[0027] Figure 2 Another structural schematic diagram of a fault diagnosis system according to an embodiment of the present invention is shown;

[0028] Figure 3 Another structural schematic diagram of a fault diagnosis system according to an embodiment of the present invention is shown;

[0029] Figure 4 Another structural schematic diagram of a fault diagnosis system according to an embodiment of the present invention is shown;

[0030] Figure 5 A schematic diagram of a fault diagnosis system for a display device including a user terminal according to an embodiment of the present invention is shown.

[0031] Figure 6 A schematic diagram of a fault diagnosis system based on a surround view controller according to an embodiment of the present invention is shown.

[0032] Figure 7 An interface displaying fault diagnosis results according to an embodiment of the present invention is shown;

[0033] Figure 8 This illustrates a display interface containing runtime log information according to an embodiment of the present invention;

[0034] Figure 9 A flowchart illustrating a fault diagnosis method according to an embodiment of the present invention is shown;

[0035] Figure 10 A schematic diagram of the structure of a surround view controller provided in an embodiment of the present invention is shown;

[0036] Figure 11 A schematic diagram of a storage medium provided in an embodiment of the present invention is shown. Detailed Implementation

[0037] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the invention. Furthermore, it should be noted that, for ease of description, only the parts relevant to the invention are shown in the accompanying drawings.

[0038] It should be noted that, unless otherwise specified, the embodiments and features described in the present invention can be combined with each other. The present invention will now be described in detail with reference to the accompanying drawings and embodiments.

[0039] Since controllers are generally located inside their respective devices, troubleshooting and diagnosis of controller faults is inconvenient. Most related technologies add external diagnostic devices to the outside of the controller to diagnose faults. However, this approach not only increases the overall load on the equipment and costs, but also fails to provide users with a real-time and intuitive display of the controller's operating status, resulting in poor visibility.

[0040] To address the aforementioned problems, this invention provides a fault diagnosis system and method. The system allows the controller itself to obtain target data characterizing whether it is malfunctioning based on its operational data. A display interface is then generated based on this target data and output to a display device for viewing. The target data includes fault diagnosis results and / or operational log information, thus providing two different display interfaces. This allows for a more intuitive and diverse presentation of the controller's fault status to the user, resulting in a high degree of visualization. Furthermore, the operational data includes both the controller's own data and external data from connected external input devices. Target data obtained from the controller's own data enables fault diagnosis even with limited external input devices, resolving the inconvenience of troubleshooting and diagnosing faults within the controller's internal equipment. Target data obtained from external data can detect data transmission failures between the controller and external input devices, thereby improving the accuracy of controller fault diagnosis.

[0041] Figure 1 This diagram illustrates the structure of a fault diagnosis system according to the present invention. In an embodiment of the present invention, the fault diagnosis system includes a controller 01 and a display device 02. The controller 01 includes an embedded graphical interface system and a video output interface 03, and the display device 02 is connected to the video output interface 03. The controller 01 is used to obtain target data characterizing whether the controller 01 is faulty based on the controller's operating data, draw a display interface based on the target data through the embedded graphical interface system, and transmit the display interface to the display device 02 for display through the video output interface 03.

[0042] In one example, controller 01 can be any controller in the automotive field, such as a vehicle controller, engine controller, motor controller, or surround view controller, or a controller from other fields; there are no restrictions here.

[0043] In one example, the video output interface 03 can be an interface that supports video and interface output, such as an LVDS interface, AHD interface, or CVBS interface, which can send video or image data from the controller to the display device for display.

[0044] In one example, the video output interface 03 can also be an interface with bidirectional output function. For example, the video output interface 03 includes a network interface-type video output interface. In this case, the video output interface 03 can not only send the video or image data in the controller to the display device for display, but also transmit the user's operation instructions based on the display device 02 to the controller 01.

[0045] In one example, display device 02 can be a standalone display screen or a display device included in a terminal device.

[0046] In one example, the embedded graphical interface system has image processing capabilities. The embedded graphical interface system can be embedded into the controller through integration technology to realize UI (User Interface) interaction.

[0047] In this embodiment of the invention, the controller 01 obtains target data to characterize whether the controller is faulty based on the controller's operating data, enabling fault diagnosis of the controller itself. The controller 01 draws a display interface based on the target data through an embedded graphical interface system and transmits the display interface to a display device for display through a video output interface 03. The controller's operating data also includes operating log information. Therefore, the target data obtained based on the operating data includes fault diagnosis results and / or operating log information. The display interface is drawn based on the target data, so the display interface also includes fault diagnosis results and / or operating log information. This allows the diagnostic results of whether the controller is faulty to be displayed to the user intuitively. Furthermore, displaying the controller's operating log information to the user facilitates maintenance personnel in quickly locating the source of the fault when the controller fails.

[0048] It should be noted that, as Figure 1 The fault diagnosis system shown uses the controller's internal data during operation when the controller 01 has no external input devices. This internal data can include the controller's operating temperature, resource utilization, system abnormal signals, etc. In this way, the controller can be self-diagnosed even when it has no external input devices or few external input devices.

[0049] In this embodiment, controller 01 is used to determine the fault diagnosis result of the controller based on the controller's operating data. The fault diagnosis result of the controller includes at least one of the following: device temperature, CPU utilization, camera status, surround view function status, CAN status, system status, and recording status. Specifically, device temperature represents the temperature of the controller; CPU utilization represents the resource utilization of the controller; camera status represents the connection status of the data transmission channel between the controller and the camera; surround view function status represents whether the controller can generate a complete top-down view; CAN status represents the communication line connection status between the controller and the central control screen; system status represents whether the fault diagnosis system itself has abnormal signals; and recording status represents whether the video data from the camera has been normally written to the storage module. In one example, a schematic diagram of the fault diagnosis result is shown below. Figure 7 .

[0050] Figure 2 This diagram illustrates another structural schematic of a fault diagnosis system provided in one embodiment of the present invention, as shown below. Figure 2 As shown, the fault diagnosis system also includes an input device 05, and the controller also includes a data acquisition interface 04. The input device 05 is connected to the data acquisition interface 04, and the controller 01 receives external data input from the input device 04 through the data acquisition interface 04.

[0051] It is understandable that when the controller 01 is connected to the input device 05, the controller's operating data includes external data. The controller can obtain target data to characterize whether the controller is faulty based on its own internal data and the received external data during operation. Based on the target data, the interface is drawn and displayed through the embedded graphical interface system, which can improve the fault diagnosis accuracy of the controller.

[0052] In one example, input device 05 could be an audio capture device, a video capture device, etc., without limitation.

[0053] When the controller obtains target data to characterize whether the controller is faulty based on the received external data, the connection relationship between the controller and the input device can be determined by judging whether there is external data or whether the external data is complete, so as to detect whether the controller is faulty.

[0054] The above-mentioned method of drawing the display interface through the controller and displaying the display interface through the display device is not limited by the function of the display device. Even when the display device does not have data processing function, that is, when the display device is just a simple display screen, the target data can still be displayed, making the fault diagnosis system have a wide range of applications.

[0055] Figure 3 This diagram illustrates another structural schematic of a fault diagnosis system provided in an embodiment of the present invention, with reference to... Figure 3The controller 01 and the display device 02 are also connected via a communication line 07. The display device 02 also includes an external export interface 06. The controller 01 is also used to transmit the target data to the display device 02 via the communication line 07. The display device 02 is also used to export the target data via the external export interface 06.

[0056] In one example, communication line 07 can be a network connection cable, a UART (Universal Asynchronous Receiver / Transmitter) serial port connection cable, or a CAN bus. When the video output interface is a unidirectional output interface, communication line 07 can enable controller 01 to transmit target data to display device 02. Display device 02 can then export the target data through external export interface 06, for example, exporting the target data to an operation and maintenance terminal or a storage hard drive. This is suitable for scenarios that require direct acquisition of target data.

[0057] In one example, the display device 02 may have data processing capabilities. For instance, the display device 02 may also have a graphical interface system. After receiving the target data, the display device 02 draws and displays the display interface based on its own image processing capabilities. In this way, the fault diagnosis system can be applied to scenarios with display devices that have data processing capabilities.

[0058] In this embodiment, the communication line 07 can also transmit the user's operation instructions based on the display device 02 to the controller. For example, the user's screen switching operation, click, single click, double click, touch point and other interactive signals are transmitted to the controller 01 through the communication line 07 so that the controller 01 can perform the corresponding function according to the above interactive signals.

[0059] Figure 4 This diagram illustrates another structural schematic of a fault diagnosis system provided in one embodiment of the present invention, with reference to... Figure 4 The display device also includes a network transmission module 08, and the system also includes a server 09. The display device 02 communicates with the server 09 through the network transmission module 08. The display device 02 is used to transmit target data to the server through the network transmission module 08.

[0060] In one example, the network transmission module 08 can realize data transmission between the display device 02 and the server 09. After the display device 02 transmits the target data to the server 09, the relevant maintenance personnel can obtain the target data through the server, thereby realizing remote diagnosis of the controller.

[0061] Figure 5 This diagram illustrates a fault diagnosis system structure for a display device including a user terminal, according to an embodiment of the present invention. (Refer to...) Figure 5The controller 01 also includes a wireless communication module 11, and the display device 02 includes a user terminal 10. The controller 01 is also used to send the display interface to the user terminal 10 through the wireless communication module 11.

[0062] In one example, the user terminal 10 can be a smartphone, computer, tablet, or other device. The user terminal 10 has communication and display functions. The controller 01 can establish a data transmission channel with the user terminal through a wireless communication module and transmit the target data to the user terminal. This allows the user to monitor the controller's operation status in real time through the user terminal. Even if the controller's video output interface and communication line connection fail, the controller's fault can still be detected, further expanding the application scenarios of the fault diagnosis system.

[0063] Figure 6 This diagram illustrates the structure of a fault diagnosis system based on a surround view controller according to an embodiment of the present invention. (Refer to...) Figure 6 The controller includes a vehicle surround view controller 60, and the display device includes a vehicle central control screen 67.

[0064] In an embodiment of the present invention, the surround view controller 60 is used to obtain target data for characterizing whether the surround view controller is faulty based on its own internal data during operation and video data input from an external image acquisition device connected to the surround view controller, draw a display interface based on the target data, and transmit the display interface to the central control screen for display.

[0065] The surround view controller primarily uses images captured by multiple cameras installed at the front, rear, left, and right of the vehicle. These images are processed through perspective transformation to create multiple top-down views centered on the vehicle. These are then stitched together using a synthesis algorithm to provide the driver with a complete 360-degree environmental perception. The main input device connected to the surround view controller is the camera. The controller also connects to the central control screen to transmit the generated top-down view and receive user touch operation commands from the screen. Therefore, the surround view controller requires very few external devices, and existing controllers lack 4G, Wi-Fi, or other external connectivity, which greatly complicates fault diagnosis.

[0066] In embodiments of the present invention, the surround view controller 60 can obtain target data to characterize whether the surround view controller is faulty based on its own internal data and video data input from the camera connected to the surround view controller during operation. Based on the target data, a display interface is drawn and transmitted to the central control screen for display. The controller can perform self-diagnosis based on its own internal data and video data. The display interface containing fault diagnosis results and / or operation log information is then displayed on the central control screen 67, allowing users to intuitively see the current status of the surround view controller, which has excellent visibility.

[0067] like Figure 6 As shown, the surround view controller 60 includes a processing module 61, and a video acquisition module 62, a vehicle signal acquisition module 63, a video output module 64, and a storage module 65 connected to the processing module 61. The video acquisition module 62 is connected to a camera 66 via a video acquisition interface 69. The vehicle signal acquisition module 63 is connected to a communication line via a vehicle signal acquisition interface 68. The vehicle signal acquisition interface 68 can be connected to vehicle sensors to collect vehicle data such as reversing, steering, and speed. The vehicle signal acquisition module 63 can also collect interactive signals from the central control screen, such as screen switching operations, clicks, single clicks, double clicks, and touch points, transmitted via the communication line. The video output module 64 is connected to the central control screen 67 via a video output interface 03 to send the complete top view and display interface generated by the processing module to the display device. The storage module 65 stores the surround view controller's operating data, external data, fault diagnosis results, and operating log information.

[0068] In one example, the target data obtained, based on the surround view controller's internal data during operation and video data input from an external image acquisition device connected to the surround view controller, includes fault diagnosis results and / or operation log information. The fault diagnosis results include diagnostic results for one or more of the following: the surround view controller's temperature, resource utilization, and the connection status of the data transmission interface with external input devices.

[0069] Figure 7 This illustrates a display interface that includes fault diagnosis results. (Refer to...) Figure 7The fault diagnosis results include at least one of the following: device temperature, CPU utilization, camera status, surround view function status, CAN status, system status, and recording status. Specifically, device temperature represents the current temperature of the surround view controller; CPU utilization represents the resource utilization of the surround view controller; camera status represents the connection status of the data transmission channel between the surround view controller and the camera; surround view function status represents whether the surround view controller can generate a complete top-down view; CAN status represents the communication line connection status between the surround view controller and the central control screen; system status represents whether the fault diagnosis system itself has any abnormal signals; and recording status represents whether the camera's video data has been correctly written to the storage module.

[0070] Figure 8 This demonstrates a display interface that includes runtime log information. (See reference) Figure 8 The operation log information includes real-time operation logs of the surround view controller during operation. The logs contain program information such as time, key execution steps, and execution status. The log information on the display interface is sorted by time and includes a slider control, allowing users to view historical operation logs. This facilitates troubleshooting for maintenance personnel by using the operation log information.

[0071] This invention provides a fault diagnosis system whose controller includes a surround view controller. The system can obtain target data to characterize whether the surround view controller is faulty based on its own internal data during operation and video data input from an external image acquisition device connected to the surround view controller. Based on the target data, a display interface is drawn and transmitted to the central control screen for display. On the one hand, it can realize self-diagnosis of the surround view controller, and on the other hand, it can intuitively display the diagnostic results to the user, which has good visibility and improves the user experience.

[0072] The description of the various embodiments above tends to emphasize the differences between the various embodiments. The similarities or similarities between them can be referred to, and for the sake of brevity, they will not be repeated here.

[0073] Another embodiment of the present invention provides a vehicle that includes the fault diagnosis system provided in any of the above embodiments.

[0074] In one example, the fault diagnosis system includes a surround view controller and a central control screen. The surround view controller is used to obtain target data to characterize whether the surround view controller is faulty, based on its own internal data during operation and video data input from an external image acquisition device connected to the surround view controller. Based on the target data, a display interface is drawn and transmitted to the central control screen for display.

[0075] The vehicles provided in the above embodiments of the present invention and the fault diagnosis system provided in the embodiments of the present invention are based on the same inventive concept and have the same beneficial effects.

[0076] Another embodiment of the present invention provides a fault diagnosis method, which is applied to the fault diagnosis system provided in the above embodiments. Figure 9 A flowchart of a fault diagnosis method is shown, for reference. Figure 9 The method includes the following steps S901 to S903:

[0077] S901. Based on the controller's operating data, obtain target data to characterize whether the controller is faulty.

[0078] In one example, the controller's operational data includes its own internal data during operation, which includes, but is not limited to, the controller's temperature, memory usage, presence of abnormal signals, program running status, and whether the controller's functions are complete.

[0079] Based on the controller's operational data, target data characterizing whether the controller is faulty can be obtained by comparing preset standard data with the operational data. For example, the controller's real-time temperature can be compared with a preset standard temperature to determine if the controller temperature is abnormal. Similarly, the controller's current memory usage rate can be compared with a preset memory usage rate to determine if excessive memory is being used. Furthermore, preset controller function data can be used to check the number and completeness of the controller's functions. When the controller is fault-free, the target data includes the controller's real-time data; for example, if the preset standard temperature is 80℃ and the controller's current temperature is 65℃, then the target data is 65℃. When the controller is faulty, the target data includes specific information indicating the fault. For example, if the controller's current temperature is 90℃, the target data indicates that the controller temperature is exceeding the standard; or, if the operational data includes abnormal data transmission and reception functions of the controller, then the target data indicates abnormal controller transmission and reception.

[0080] In this embodiment, the target data includes the controller's fault diagnosis results. The fault diagnosis results include real-time information indicating that the controller is normal or fault results indicating that the controller is faulty.

[0081] In one example, the controller's operating data also includes operating log information. The target data obtained from the controller's operating data includes the controller's fault diagnosis results and / or operating log information. The operating log information can reflect the key steps in the controller's program operation process. Using the operating log information as the target data can facilitate maintenance personnel to troubleshoot problems based on the operating log information, which is conducive to quickly eliminating faults.

[0082] S902. Draw and display interface based on target data.

[0083] In this embodiment, the target data includes fault diagnosis results and / or operation log information. Based on this, when the target data includes fault diagnosis results, the display interface includes the fault diagnosis results; when the target data includes operation log information, the display interface includes the operation log information; when the target data includes both fault diagnosis results and operation log information, two display interfaces can be drawn to display the fault diagnosis results and operation log information separately.

[0084] In one example, taking a controller that includes a surround-view controller as an example, refer to... Figure 7 The fault diagnosis results include equipment temperature, CPU utilization, camera status, surround view function status, CAN status, system status, and recording status. Specifically, equipment temperature represents the current temperature of the surround view controller; CPU utilization represents the resource utilization of the surround view controller; camera status represents the connection status of the data transmission channel between the surround view controller and the camera; surround view function status represents whether the surround view controller can generate a complete top-down view; CAN status represents the communication line connection status between the surround view controller and the central control screen; system status represents whether the fault diagnosis system itself has any abnormal signals; and recording status represents whether the camera's video data has been correctly written to the storage module.

[0085] refer to Figure 8 The operation log information includes real-time operation logs of the surround view controller during operation. The logs contain program information such as time, key execution steps, and execution status. The log information on the display interface is sorted by time and includes a slider control, allowing users to view historical operation logs. This facilitates troubleshooting for maintenance personnel by using the operation log information.

[0086] S903: Transmit the display interface to the display device for display.

[0087] Based on the display interface containing fault diagnosis results and / or operation log information obtained in step S902, the controller transmits the display interface to the display device through the video output interface. The display device displays the display interface so that the user can view and understand the operating status of the controller.

[0088] The fault diagnosis method provided in this embodiment can obtain target data to characterize whether the surround view controller is faulty based on the data during the controller's operation. A display interface is drawn based on the target data and transmitted to a display device for display. On the one hand, it can realize the self-diagnosis of the controller, and on the other hand, it can intuitively display the diagnostic results to the user, which has good visibility and improves the user experience.

[0089] In this embodiment of the invention, when the target data includes the fault diagnosis result of the controller, the above step S901 obtains target data for characterizing whether the controller is faulty based on the controller's operating data, including: performing fault analysis on the controller based on the controller's own internal data and external data input by external input devices connected to the controller, obtaining fault diagnosis results, and using the fault diagnosis results as target data.

[0090] In one example, the external input device connected to the controller can be an audio capture device, a video capture device, etc., and the external data can be image data, audio data, or video data.

[0091] The controller is analyzed for faults based on its internal data and external data input from external input devices connected to the controller. The results of the fault diagnosis include one or more of the following: the controller's temperature, resource utilization, and the connection status of the data transmission interface with the external input devices.

[0092] This embodiment uses a controller including a surround-view controller as an example to illustrate fault diagnosis. For example, by acquiring the controller's real-time temperature and comparing it with a preset standard temperature, a fault diagnosis result can be obtained regarding whether the controller's temperature exceeds the range. An alarm can be issued when the temperature exceeds the standard temperature. For example, by acquiring the controller's CPU utilization rate, if the CPU utilization rate continuously exceeds a preset utilization rate for a duration longer than a preset duration, an abnormal CPU utilization rate is confirmed, and an alarm can be issued. For example, if the bitstream input from an external input device (camera) to the controller is abnormal or there is no bitstream, it is determined that the camera is faulty or the interface connection between the controller and the external input device is abnormal, and an alarm can be issued. For example, by detecting the I / O status of the communication line, an abnormal I / O input indicates a communication abnormality in the controller. For example, if a system abnormality signal is generated during the controller's operation, a fault diagnosis system abnormality is determined. Furthermore, if the bitstream data input from an external input device is abnormal or the writing to the storage module is abnormal during the controller's writing process, the recording status of the controller is determined to be abnormal.

[0093] In one example, the surround view controller's internal data includes a splicing parameter table, which is obtained based on the surround view controller's parameter calibration of external input devices. In this embodiment, fault analysis is performed on the controller to obtain fault diagnosis results, including: detecting the identification information of the splicing parameter table at each startup moment of the surround view controller; if the identification information is detected, the splicing parameter table is determined to be normal; if the identification information is not detected, the splicing parameter table is determined to be abnormal.

[0094] The identification information is obtained from the complete stitching parameter table generated by the surround view controller when calibrating the parameters of external input devices. For example, the surround view controller calibrates the parameters of the images acquired by each camera based on their position to obtain a top-down view centered on the vehicle. During this process, a stitching parameter table (mesh table) is generated. If the surround view controller performs perspective transformation processing on the images acquired by the cameras and stitches them into a complete top-down view using a synthesis algorithm, the mesh table often fails, affecting the top-down view generation effect. In this embodiment, while the surround view controller generates the complete stitching parameter table during parameter calibration of external input devices, it also generates identification information based on the complete stitching parameter table. The identification information is detected in the stitching parameter table at each startup time of the surround view controller. If identification information is detected, the stitching parameter table is determined to be normal; if no identification information is detected, the stitching parameter table is determined to be abnormal. This allows for rapid detection of whether the stitching parameter table is abnormal. The fault diagnosis results based on the stitching parameter table are also used as target data to generate a display interface for easy viewing by the user.

[0095] In this embodiment of the invention, when the target data includes fault diagnosis results, step S902 above, which involves drawing a display interface based on the target data, includes: drawing the fault diagnosis interface of the controller using an embedded graphical interface system in the controller based on the fault diagnosis results, and using the fault diagnosis interface as the display interface. For example... Figure 7 The interface shown is the display interface.

[0096] In this embodiment of the invention, when the target data includes operation log information, the above step S901 obtains target data for characterizing whether the controller is faulty based on the controller's operation data, including: during the process of the controller running the program based on the operation data, the controller's operation log information is recorded in real time; during the process of recording the operation log information, if an abnormal program operation is detected, an abnormality identifier is marked in the operation log information corresponding to the abnormal program.

[0097] For example, during the fault diagnosis of the controller, the execution information of the controller's operation log is printed, which prints out the relevant information when the program is executed. If an abnormal program is detected, an abnormality mark is marked in the operation log information corresponding to the abnormal program. The abnormality mark can include marks such as "pass" or "mark" to highlight the location of the abnormal operation, which can be used to quickly locate and troubleshoot the problem.

[0098] In this embodiment of the invention, when the target data includes operation log information, step S902 above, which involves drawing a display interface based on the target data, includes: drawing a log viewing interface for the controller using an embedded graphical interface system in the controller based on the operation log information, and using the log viewing interface as the display interface. For example... Figure 8 The interface shown is the display interface.

[0099] In this embodiment of the invention, the fault diagnosis method further includes: drawing a log viewing interface through an embedded graphical interface system at preset intervals, and / or receiving a log viewing instruction transmitted by a display device, and drawing a log viewing interface through an embedded graphical interface system in response to the user's log viewing instruction.

[0100] Every preset time interval, the embedded graphical interface system draws a log viewing interface. For example, the controller's operation log information is stored, and the controller draws a log viewing interface based on the operation log information periodically.

[0101] Understandably, the display device has a display screen, and users can interact with the computer through the display screen. Operation controls can be set on the display screen. For example, when the user inputs a log viewing command through the operation controls, the display device transmits the log viewing command to the controller, and the controller draws the log viewing interface through the embedded graphical interface system.

[0102] In one example, considering that the vehicle's controller and the display device use different systems, the fault diagnosis method in this embodiment further includes: transmitting the target data to the display device based on a preset encapsulation protocol, wherein the preset encapsulation protocol includes any one of bit-byte private protocols, JSON, and XML. Thus, data transmission between the vehicle and the display device can be performed in multiple ways.

[0103] In one example, refer to Figure 3 The display device also includes an external export interface, see reference. Figure 4 The fault diagnosis system also includes a server. Based on this, the fault diagnosis method in this embodiment further includes: sending target data to the server via a display device, and / or exporting the target data via an external export interface on the display device. This makes this embodiment applicable to scenarios requiring direct acquisition of target data, and enables remote diagnosis of the controller.

[0104] The fault diagnosis method provided in the above embodiments of the present invention and the fault diagnosis system method provided in the embodiments of the present invention are based on the same inventive concept and have the same beneficial effects.

[0105] Please refer to Figure 10 This illustrates a schematic diagram of a surround-view controller provided by some embodiments of the present invention. For example... Figure 10As shown, the surround view controller 20 includes: a processor 200, a memory 201, a bus 202, and a communication interface 203. The processor 200, the communication interface 203, and the memory 201 are connected via the bus 202. The memory 201 stores a computer program that can run on the processor 200. When the processor 200 runs the computer program, it executes the method provided by any of the foregoing embodiments of the present invention.

[0106] The memory 201 may include high-speed random access memory (RAM) or non-volatile memory, such as at least one disk storage device. Communication between this system network element and at least one other network element is achieved through at least one communication interface 203 (which can be wired or wireless), such as the Internet, wide area network, local area network, or metropolitan area network.

[0107] Bus 202 can be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. The memory 201 is used to store programs. After receiving an execution instruction, the processor 200 executes the program. The fault diagnosis method disclosed in any of the foregoing embodiments of the present invention can be applied to the processor 200, or implemented by the processor 200.

[0108] The processor 200 may be an integrated circuit chip with signal processing capabilities. In implementation, each step of the above method can be completed by the integrated logic circuitry in the hardware of the processor 200 or by instructions in software form. The processor 200 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this invention. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this invention can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules may reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The storage medium is located in memory 201. The processor 200 reads the information in memory 201 and, in conjunction with its hardware, completes the steps of the above method.

[0109] The surround view controller provided in this embodiment of the invention and the fault diagnosis method provided in this embodiment of the invention are based on the same inventive concept and have the same beneficial effects as the methods they adopt, operate or implement.

[0110] This invention also provides a computer-readable storage medium corresponding to the fault diagnosis method provided in the foregoing embodiments. Please refer to [link / reference]. Figure 11 The computer-readable storage medium shown is an optical disc 30, on which a computer program (i.e., a program product) is stored. When the computer program is run by a processor, it executes the fault diagnosis method provided in any of the foregoing embodiments.

[0111] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical and magnetic storage media, which will not be elaborated here.

[0112] The computer-readable storage medium provided in the above embodiments of the present invention and the fault diagnosis method provided in the embodiments of the present invention are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented by the applications stored therein.

[0113] It should be noted that:

[0114] In the foregoing text, the terms "comprising," "including," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of the present invention is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0115] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0116] The embodiments of the present invention have been described above with reference to the accompanying drawings. These are merely specific implementations of the present invention, but the present invention is not limited to the specific implementations described above. The specific implementations described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of the present invention.

Claims

1. A fault diagnosis system, characterized in that, The system includes: a controller and a display device; the controller includes a vehicle surround view controller, and the display device includes the vehicle's central control screen; The controller includes an embedded graphical interface system and a video output interface; the display device is connected to the video output interface. The controller is configured to obtain target data characterizing whether the controller is faulty based on the controller's operating data, draw a display interface based on the target data through the embedded graphical interface system, and transmit the display interface to the display device for display through the video output interface. The target data includes the fault diagnosis results of the controller; The surround view controller is used to obtain target data to characterize whether the surround view controller is malfunctioning, based on its own internal data during operation and video data input from an external image acquisition device connected to the surround view controller; draw a display interface based on the target data; and transmit the display interface to the central control screen for display. The surround view controller is used to calibrate the parameters of the images acquired by the camera according to the position of each external image acquisition device, and generate a stitching parameter table and identification information. The stitching parameter table is used to obtain a top view centered on the vehicle, and the identification information is a feature identifier corresponding to the complete stitching parameter table. The surround view controller is also used to detect the identification information of the splicing parameter table at each startup time of the surround view controller. The fault diagnosis result includes the diagnosis result of the surround view function status. If the identification information is detected, it is determined that the splicing parameter table is normal and the surround view controller can generate a complete top view; if the identification information is not detected, it is determined that the splicing parameter table is abnormal and the surround view controller cannot generate a complete top view.

2. The fault diagnosis system according to claim 1, characterized in that, The controller is used to determine the fault diagnosis result of the controller based on the controller's operating data; The fault diagnosis results of the controller include at least one of the following: device temperature, CPU utilization, camera status, surround view function status, CAN status, system status, and recording status. The device temperature represents the temperature of the controller, the CPU utilization represents the resource utilization of the controller, the camera status represents the connection status of the data transmission channel between the controller and the camera, the CAN status represents the connection status of the communication line between the controller and the central control screen, the system status represents whether the fault diagnosis system itself has abnormal signals, and the recording status represents whether the video data of the camera has been normally written to the storage module.

3. The fault diagnosis system according to claim 1, characterized in that, The controller is also connected to the display device via a communication cable; the display device also includes an external output interface. The controller is further configured to transmit the target data to the display device via the communication line; The display device is also used to export the target data through the external export interface.

4. The fault diagnosis system according to claim 3, characterized in that, The display device further includes a network transmission module, and the system further includes a server; the display device communicates with the server through the network transmission module. The display device is used to transmit the target data to the server via the network transmission module; The controller further includes a wireless communication module, the display device includes a user terminal, and the controller is also used to send the display interface to the user terminal through the wireless communication module.

5. The fault diagnosis system according to claim 1, characterized in that, The system further includes an input device, and the controller further includes a data acquisition interface; the input device is connected to the data acquisition interface. The controller is also configured to receive external data input from the input device through the data acquisition interface, and the controller's operating data includes the external data.

6. A vehicle, characterized in that, Includes the fault diagnosis system according to any one of claims 1-5.

7. A fault diagnosis method, characterized in that, The method, applied to the fault diagnosis system according to any one of claims 1-5, comprises: Based on the controller's operational data, target data is obtained to characterize whether the controller is faulty; The display interface is created based on the target data; the target data includes the fault diagnosis results of the controller; The display interface is transmitted to a display device for display. The controller includes a vehicle surround view controller. Based on the operating data of the surround view controller, including the internal data of the surround view controller itself and the external data input by the external input device connected to the surround view controller, the controller is subjected to fault analysis to obtain fault diagnosis results, and the fault diagnosis results are used as the target data. The surround view controller is used to calibrate the parameters of the images acquired by the camera according to the position of each external image acquisition device, and generate a stitching parameter table and identification information. The stitching parameter table is used to obtain a top view centered on the vehicle, and the identification information is a feature identifier corresponding to the complete stitching parameter table. The surround view controller is also used to detect the identification information of the splicing parameter table at each startup time of the surround view controller. The fault diagnosis result includes the diagnosis result of the surround view function status. If the identification information is detected, it is determined that the splicing parameter table is normal and the surround view controller can generate a complete top view; if the identification information is not detected, it is determined that the splicing parameter table is abnormal and the surround view controller cannot generate a complete top view.

8. The method according to claim 7, characterized in that, The target data obtained based on the controller's operational data to characterize whether the controller is faulty includes: The fault diagnosis results include one or more of the following: the controller's temperature, resource utilization rate, and the connection status of the data transmission interface with the external input device.

9. The method according to claim 7, characterized in that, The controller's internal data includes a splicing parameter table, which is obtained based on the surround view controller's parameter calibration of external input devices; The controller is subjected to fault analysis to obtain fault diagnosis results, including: The identification information of the splicing parameter table at each startup moment of the surround view controller is detected, wherein the identification information is obtained based on the complete splicing parameter table generated when the surround view controller calibrates the parameters of the external input devices; If the identification information is detected, the splicing parameter table is determined to be normal; if the identification information is not detected, the splicing parameter table is determined to be abnormal.

10. The method according to claim 7 or 8, characterized in that, The target data also includes the controller's operation log information. The process of obtaining target data to characterize whether the controller is faulty based on the controller's operation data includes: During the process of the controller running the program based on the running data, the controller's running log information is recorded in real time; If a program malfunction is detected during the recording of the runtime log information, an exception identifier will be marked in the runtime log information corresponding to the malfunctioning program.

11. The method according to claim 7, characterized in that, The display interface is created based on the target data, including: Based on the fault diagnosis results, the fault diagnosis interface of the controller is drawn through the embedded graphical interface system in the controller, and the fault diagnosis interface is used as the display interface.

12. The method according to claim 10, characterized in that, The display interface is created based on the target data, including: Based on the operation log information, the log viewing interface of the controller is drawn through the embedded graphical interface system in the controller, and the log viewing interface is used as the display interface.

13. The method according to claim 12, characterized in that, The method further includes: The system draws the log viewing interface through the embedded graphical interface system at preset intervals, and / or receives log viewing instructions transmitted by the display device, and draws the log viewing interface through the embedded graphical interface system in response to the user's log viewing instructions.

14. The method according to claim 7, characterized in that, The method further includes: The target data is transmitted to the display device based on a preset encapsulation protocol; The preset encapsulation protocol includes any one of the following: bitwise byte private protocol, JSON, and XML.

15. The method according to claim 14, characterized in that, The method further includes: The target data is sent to the server via the display device, and / or the target data is exported via an external export interface on the display device.

16. A surround view controller, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the computer program to implement the method as described in any one of claims 7-15.

Images