A multi-screen display system for new energy vehicles and a fault diagnosis method

Abstract

This application discloses a fault diagnosis method for a multi-screen display system in a new energy vehicle, relating to the field of vehicle testing. The method includes: adopting a QNX+Android multi-system architecture; transmitting the displayed video stream to the screen via a screen interface based on the QNX system; transmitting the video stream to the screen via the openWFD protocol based on the Android system; using openWFD as a front-end and back-end structure, with the Android system as the front-end and the QNX system as the back-end, and the QNX system back-end module openWFDBE receiving data from the Android system front-end module openWFDFE; wherein, based on the openWFDServer module, it connects the front-end module openWFDFE, the back-end module openWFDBE, the screen interface, and the multiple screens, serving as an intermediate processing hub for screen video stream transmission; wherein, the instrument panel runs the QNX system, while the central control, passenger side, and rear entertainment screens run the Android system.

Description

Technical Field

[0001] This application relates to the field of vehicle testing, and in particular to multi-screen display systems for new energy vehicles, fault diagnosis methods for multi-screen display systems for new energy vehicles, electronic devices, storage media, and vehicle platforms. Background Technology

[0002] Currently, new energy vehicles are using a large number of screen displays, turning the cockpit into a mobile "digital cockpit".

[0003] However, when the experience relies heavily on these glass panels, a screen's occasional lag, an unexpected crash or touch malfunction, a navigation map freezing, an inability to adjust the air conditioning speed, or a completely black entertainment system... these seemingly localized malfunctions are enough to make drivers flustered and passengers extremely anxious.

[0004] In highly integrated systems, the stability of car screens is crucial. If a black screen or touch malfunction occurs, traditional diagnostic methods are time-consuming and laborious, often requiring the vehicle to be towed to a 4S shop or even undergoing complex disassembly and testing, resulting in a very poor user experience.

[0005] Therefore, a fault diagnosis method for multi-screen display systems in new energy vehicles is needed to quickly pinpoint the location of the fault and develop a multi-level processing strategy, including simple location at the software level, hardware level, front end of the data chain, and back end, effectively avoiding unnecessary vehicle disassembly and repair, and greatly improving service efficiency and user satisfaction. Summary of the Invention

[0006] The purpose of this invention is to provide a multi-screen display system for new energy vehicles, a fault diagnosis method for the multi-screen display system for new energy vehicles, electronic equipment, storage medium and vehicle platform, and to solve at least one of a number of technical problems.

[0007] In the QNX+Android multi-screen display system for new energy vehicles, screens are prone to abnormalities such as black screens, white screens, and flickering. The root causes of the faults are scattered (software: Android system, openWFD protocol; hardware: serializer, deserializer, screen, ribbon cable), and the long transmission links make it difficult to quickly and accurately locate the faults.

[0008] Traditional screen fault diagnosis requires disassembling the vehicle for inspection, which is time-consuming and labor-intensive, and may also cause unnecessary repair operations, resulting in poor user experience and low service efficiency.

[0009] This invention provides the following solution:

[0010] According to a first aspect of the present invention, a multi-screen display system for new energy vehicles is provided, the multi-screen display system for new energy vehicles comprising:

[0011] It adopts a QNX+Android multi-system architecture;

[0012] Based on the QNX system, the video stream is transmitted to the screen via the screen interface;

[0013] Based on the Android system, the video stream is transmitted to the screen via the openWFD protocol;

[0014] Based on the openWFD architecture, which is a front-end and a back-end, the Android system is the front-end and the QNX system is the back-end. The QNX system back-end module openWFDBE receives data from the Android system front-end module openWFDFE.

[0015] Among them, based on the openWFDServer module, it connects the front-end module openWFDFE, the back-end module openWFDBE, the screen interface, and multiple screens, serving as an intermediate processing hub for screen video stream transmission.

[0016] The instrument panel runs the QNX system, while the entertainment screens in the center console, passenger seat, and rear seats run the Android system.

[0017] Furthermore, it also includes: DP / DSI interface and I2C interface;

[0018] The openWFDServer module outputs the processed parallel video stream to the screen via the DP / DSI interface;

[0019] Among them, after passing through the serializer and deserializer, the parallel video stream reaches the screen;

[0020] Among them, the serializer and deserializer are instructions for the controlled I2C interface.

[0021] According to a second aspect of the present invention, a fault diagnosis method for a multi-screen display system in a new energy vehicle is provided, the fault diagnosis method for the multi-screen display system in a new energy vehicle includes:

[0022] Set up the first image data to be implanted into the serializer;

[0023] The first diagnostic command is sent via the I2C interface to control the serializer to send the first image data to the deserializer.

[0024] The fault status of the multi-screen display system is determined based on the status of the first image data output on the screen.

[0025] Furthermore, including:

[0026] The first diagnostic command is sent through the I2C interface to control the serializer to send the first image data to the deserializer. The fault status of the multi-screen display system is determined based on the status of the first image data output on the screen.

[0027] If the screen output of the first image data is normal, the fault is located at the front end of the serializer.

[0028] Furthermore, including:

[0029] Set up a second image data implantation deserializer;

[0030] The second diagnostic command is sent via the I2C interface to control the deserializer to send the second image data to the screen.

[0031] The fault status of the multi-screen display system can be determined based on the status of the second image data output on the screen.

[0032] Furthermore, including:

[0033] If the screen output of the first image data is abnormal, a second diagnostic command is sent through the I2C interface to control the deserializer to send the second image data to the screen. The fault status of the multi-screen display system is determined based on the status of the screen output of the second image data.

[0034] If the screen output shows the data status of the second image normally, then the fault is located at the front end of the relative deserializer.

[0035] Furthermore, including:

[0036] Based on the real-time video stream data source of the vehicle's infotainment system, monitor the screen display status;

[0037] If the screen displays an abnormal real-time status of the corresponding vehicle infotainment system's video stream, a first diagnostic command will be generated.

[0038] If the screen output shows an abnormal state corresponding to the first image data, a second diagnostic instruction will be generated.

[0039] If the data status of the second image output on the screen is abnormal, log data indicating that the current vehicle system diagnostic strategy has failed will be generated.

[0040] According to a third aspect of the present invention, an electronic device is provided, comprising: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0041] The memory stores a computer program, which, when executed by the processor, causes the processor to perform steps such as those in a fault diagnosis method for a multi-screen display system in a new energy vehicle.

[0042] According to a fourth aspect of the present invention, a computer-readable storage medium is provided, storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform steps such as those of a fault diagnosis method for a multi-screen display system in a new energy vehicle.

[0043] According to a fifth aspect of the present invention, a vehicle platform is provided, comprising:

[0044] Electronic devices, used to implement fault diagnosis methods for systems such as multi-screen display systems in new energy vehicles;

[0045] The processor runs programs, and when the programs are running, they execute steps from data output by electronic devices, such as fault diagnosis methods for multi-screen display systems in new energy vehicles.

[0046] Storage medium used to store programs that, when running, execute steps such as fault diagnosis methods for multi-screen display systems in new energy vehicles based on data output from electronic devices.

[0047] The above solution achieves the following beneficial technical effects:

[0048] This application employs a two-step diagnostic method that uses I2C control to output built-in image and video streams from the serializer and deserializer. This method can pinpoint the faulty component (vehicle infotainment system / serializer / deserializer / screen) within minutes, significantly reducing diagnostic time and quickly locating the fault.

[0049] This application accurately identifies the scope of the fault, allowing for the identification of the core problem without disassembling the vehicle, reducing unnecessary repair operations, lowering service costs, and avoiding ineffective vehicle disassembly.

[0050] This application addresses the pain point of inefficient traditional diagnostics, improves repair service efficiency, eliminates user concerns about the reliability of multi-screen systems, significantly enhances user satisfaction, and improves service and user experience.

[0051] This application provides precise guidance for subsequent repairs by clearly defining the boundaries between software (vehicle-side) and hardware (transmission components, screen) faults, avoiding blind troubleshooting and clarifying the fault type. Attached Figure Description

[0052] Figure 1 This is a structural diagram of a multi-screen display system for new energy vehicles provided by one or more embodiments of the present invention.

[0053] Figure 2 This is a flowchart of a fault diagnosis method for a multi-screen display system for new energy vehicles provided by one or more embodiments of the present invention.

[0054] Figure 3This is a schematic diagram of the QNX+Android display architecture provided in a specific embodiment of the present invention.

[0055] Figure 4 This is a schematic diagram of a fault diagnosis link provided in a specific embodiment of the present invention.

[0056] Figure 5 This is a schematic diagram of the video stream data flow from the vehicle's infotainment system to the screen, provided in a specific embodiment of the present invention.

[0057] Figure 6 This is a schematic diagram of fault diagnosis based on a serializer provided in a specific embodiment of the present invention.

[0058] Figure 7 This is a schematic diagram of fault diagnosis based on a serializer and a deserializer provided in a specific embodiment of the present invention.

[0059] Figure 8 This is an electronic device structural block diagram of a fault diagnosis method for a multi-screen display system for new energy vehicles provided in one or more embodiments of the present invention. Detailed Implementation

[0060] The technical solution of the present invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0061] Figure 1 This is a structural diagram of a multi-screen display system for new energy vehicles provided by one or more embodiments of the present invention.

[0062] like Figure 1 The multi-screen display system for new energy vehicles shown includes:

[0063] It adopts a QNX+Android multi-system architecture;

[0064] Based on the QNX system, the video stream is transmitted to the screen via the screen interface;

[0065] Based on the Android system, the video stream is transmitted to the screen via the openWFD protocol;

[0066] Based on the openWFD architecture, which is a front-end and back-end structure, the Android system belongs to the front-end and the QNX system belongs to the back-end. The QNX system back-end module openWFD BE receives data from the Android system front-end module openWFD FE.

[0067] Among them, based on the openWFD Server module, it connects the front-end module openWFD FE, the back-end module openWFDBE, the screen interface, and multiple screens, serving as an intermediate processing hub for screen video stream transmission;

[0068] The instrument panel runs the QNX system, while the entertainment screens in the center console, passenger seat, and rear seats run the Android system.

[0069] In this embodiment, it also includes: a DP / DSI interface and an I2C interface;

[0070] The openWFD Server module outputs the processed parallel video stream to the screen via the DP / DSI interface;

[0071] Among them, after passing through the serializer and deserializer, the parallel video stream reaches the screen;

[0072] Among them, the serializer and deserializer are instructions for the controlled I2C interface.

[0073] Figure 2 This is a flowchart of a fault diagnosis method for a multi-screen display system for new energy vehicles provided by one or more embodiments of the present invention.

[0074] like Figure 2 The fault diagnosis methods for the multi-screen display system of new energy vehicles shown include:

[0075] Step S1: Set up the first image data implantation serializer;

[0076] Step S2: Send a first diagnostic command through the I2C interface to control the serializer to send the first image data to the deserializer;

[0077] Step S3: Determine the fault status of the multi-screen display system based on the status of the first image data output on the screen.

[0078] In this embodiment, it includes:

[0079] The first diagnostic command is sent through the I2C interface to control the serializer to send the first image data to the deserializer. The fault status of the multi-screen display system is determined based on the status of the first image data output on the screen.

[0080] If the screen output of the first image data is normal, the fault is located at the front end of the serializer.

[0081] In this embodiment, it includes:

[0082] Set up a second image data implantation deserializer;

[0083] The second diagnostic command is sent via the I2C interface to control the deserializer to send the second image data to the screen.

[0084] The fault status of the multi-screen display system can be determined based on the status of the second image data output on the screen.

[0085] In this embodiment, it includes:

[0086] If the screen output of the first image data is abnormal, a second diagnostic command is sent through the I2C interface to control the deserializer to send the second image data to the screen. The fault status of the multi-screen display system is determined based on the status of the screen output of the second image data.

[0087] If the screen output shows the data status of the second image normally, then the fault is located at the front end of the relative deserializer.

[0088] In this embodiment, it includes:

[0089] Based on the real-time video stream data source of the vehicle's infotainment system, monitor the screen display status;

[0090] If the screen displays an abnormal real-time status of the corresponding vehicle infotainment system's video stream, a first diagnostic command will be generated.

[0091] If the screen output shows an abnormal state corresponding to the first image data, a second diagnostic instruction will be generated.

[0092] If the data status of the second image output on the screen is abnormal, log data indicating that the current vehicle system diagnostic strategy has failed will be generated.

[0093] It is worth noting that although this system / device only discloses the above-mentioned modules / units, it does not mean that this system / device is limited to the above-mentioned basic functional modules. On the contrary, what this invention intends to express is that, based on the above-mentioned basic functional modules, those skilled in the art can add one or more functional modules in combination with the prior art to form an infinite number of embodiments or technical solutions. That is to say, this system is open rather than closed. It cannot be assumed that the scope of protection of the claims of this invention is limited to the above-disclosed basic functional modules just because this embodiment only discloses a few basic functional modules.

[0094] In one specific embodiment, a multi-screen display system for new energy vehicles is disclosed, such as... Figure 3 As shown. By Figure 3 Evolved to Figure 4 Extract the fault diagnosis link. Figure 4 Under normal operation, such as Figure 5The QNX system transmits the video stream to the serializer, usually through the DP or DSI interface. The data is parallel (for example, the DP interface supports up to 4 lanes of simultaneous transmission). The serializer is responsible for modifying the parallel data in the video stream into serial data and passing it to the deserializer. The deserializer then modifies the serial data back into parallel data and transmits it to the screen through the DP or DSI interface.

[0095] If the screen exhibits black and white flickering, it could be a software issue or a hardware issue.

[0096] If the central control screen is black, it could be a problem with Android, OpenWFD, the serializer, the serializer, or even the screen itself.

[0097] In this embodiment, as Figure 6 As shown, the video streamer can output its own video stream instead of using the in-vehicle infotainment system's stream. An image can be stored in the video streamer, and via I2C control, the video streamer can send this image as a video stream to the deserializer and then to the screen. If the screen displays the image correctly, the problem lies with the in-vehicle infotainment system. If the screen cannot display the image correctly, the problem is not with the in-vehicle infotainment system, but with the video streamer and the components following it.

[0098] In this embodiment, as Figure 7 As shown, the deserializer outputs its own video stream, eliminating the need for the serializer's video stream. An image can be stored in the deserializer, and via I2C control, the deserializer can transmit this image as a video stream to the screen. If the screen displays the image correctly, the problem lies with the vehicle's infotainment system and the serializer. If the screen does not display the image correctly, the problem is not with the infotainment system or the serializer, but with the part after the deserializer.

[0099] Figure 8 This is an electronic device structural block diagram of a fault diagnosis method for a multi-screen display system for new energy vehicles provided in one or more embodiments of the present invention.

[0100] like Figure 8 As shown, this application provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;

[0101] The memory stores a computer program, which, when executed by the processor, causes the processor to perform the steps of a fault diagnosis method for a multi-screen display system in a new energy vehicle.

[0102] This application also provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of a fault diagnosis method for a multi-screen display system in a new energy vehicle.

[0103] This application also provides a vehicle platform, including:

[0104] Steps for diagnosing faults in electronic devices used to implement multi-screen display systems in new energy vehicles;

[0105] The processor runs a program, and when the program runs, it executes the steps of a fault diagnosis method for a multi-screen display system in a new energy vehicle from data output by the electronic device.

[0106] The storage medium is used to store the program, which, when running, executes the steps of the fault diagnosis method for the multi-screen display system of new energy vehicles based on the data output from the electronic device.

[0107] The communication bus mentioned in the above electronic devices can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used to represent it in the diagram, but this does not indicate that there is only one bus or one type of bus.

[0108] The electronic device comprises a hardware layer, an operating system layer running on top of the hardware layer, and an application layer running on the operating system. The hardware layer includes hardware such as a central processing unit (CPU), a memory management unit (MMU), and memory. The operating system can be any one or more computer operating systems that control the electronic device through processes, such as Linux, Unix, Android, iOS, or Windows. Furthermore, in this embodiment of the invention, the electronic device can be a smartphone, tablet computer, or other handheld device, or a desktop computer, portable computer, or other electronic device; there is no particular limitation in this embodiment.

[0109] In this embodiment of the invention, the executing entity for electronic device control can be an electronic device itself, or a functional module within an electronic device capable of calling and executing a program. The electronic device can obtain the firmware corresponding to the storage medium. This firmware is provided by the supplier, and different storage media may have the same or different firmware; no limitation is made here. After obtaining the firmware corresponding to the storage medium, the electronic device can write this firmware into the storage medium; specifically, it burns the firmware corresponding to the storage medium into the storage medium. The process of burning the firmware into the storage medium can be implemented using existing technology, and will not be elaborated upon in this embodiment of the invention.

[0110] Electronic devices can also obtain reset commands corresponding to the storage media. The reset commands corresponding to the storage media are provided by the supplier. The reset commands corresponding to different storage media can be the same or different, and no restrictions are imposed here.

[0111] At this time, the storage medium of the electronic device is a storage medium on which the corresponding firmware has been written. The electronic device can respond to the reset command corresponding to the storage medium on which the corresponding firmware has been written, thereby resetting the storage medium on which the corresponding firmware has been written according to the reset command. The process of resetting the storage medium according to the reset command can be implemented by existing technology and will not be described in detail in this embodiment of the invention.

[0112] For ease of description, the above devices are described separately by function as various units and modules. Of course, in implementing this application, the functions of each unit and module can be implemented in one or more software and / or hardware.

[0113] It will be understood by those skilled in the art that, unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. It should also be understood that terms such as those defined in general dictionaries should be understood to have the meaning consistent with their meaning in the context of the prior art, and should not be interpreted in an idealized or overly formal sense unless specifically defined.

[0114] For the sake of simplicity, the method embodiments are described as a series of actions. However, those skilled in the art should understand that the embodiments of the present invention are not limited to the described order of actions, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions involved are not necessarily essential to the embodiments of the present invention.

[0115] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of this application.

[0116] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A multi-screen display system for new energy vehicles, characterized in that, The new energy vehicle multi-screen display system includes: It adopts a QNX+Android multi-system architecture; Based on the QNX system, the video stream is transmitted to the screen via the screen interface; Based on the Android system, the video stream is transmitted to the screen via the openWFD protocol; Based on the openWFD architecture, which is a front-end and a back-end, the Android system is the front-end and the QNX system is the back-end. The QNX system back-end module openWFDBE receives data from the Android system front-end module openWFDFE. Among them, based on the openWFDServer module, it connects the front-end module openWFDFE, the back-end module openWFDBE, the screen interface, and multiple screens, serving as an intermediate processing hub for screen video stream transmission. The instrument panel runs the QNX system, while the entertainment screens in the center console, passenger seat, and rear seats run the Android system.

2. The multi-screen display system for new energy vehicles according to claim 1, characterized in that, Also includes: DP / DSI interface and I2C interface; The openWFDServer module outputs the processed parallel video stream to the screen via the DP / DSI interface; Among them, after passing through the serializer and deserializer, the parallel video stream reaches the screen; Among them, the serializer and deserializer are instructions for the controlled I2C interface.

3. A fault diagnosis method for a multi-screen display system in a new energy vehicle, characterized in that, The fault diagnosis method for the multi-screen display system of new energy vehicles includes: Set up the first image data to be implanted into the serializer; The first diagnostic command is sent via the I2C interface to control the serializer to send the first image data to the deserializer. The fault status of the multi-screen display system is determined based on the status of the first image data output on the screen.

4. The fault diagnosis method for a multi-screen display system in a new energy vehicle according to claim 3, characterized in that, include: The first diagnostic command is sent through the I2C interface to control the serializer to send the first image data to the deserializer. The fault status of the multi-screen display system is determined based on the status of the first image data output on the screen. If the screen output of the first image data is normal, the fault is located at the front end of the serializer.

5. The fault diagnosis method for a multi-screen display system in a new energy vehicle according to claim 4, characterized in that, include: Set up a second image data implantation deserializer; The second diagnostic command is sent via the I2C interface to control the deserializer to send the second image data to the screen. The fault status of the multi-screen display system can be determined based on the status of the second image data output on the screen.

6. The fault diagnosis method for a multi-screen display system in a new energy vehicle according to claim 5, characterized in that, include: If the screen output of the first image data is abnormal, a second diagnostic command is sent through the I2C interface to control the deserializer to send the second image data to the screen. The fault status of the multi-screen display system is determined based on the status of the screen output of the second image data. If the screen output shows the data status of the second image normally, then the fault is located at the front end of the relative deserializer.

7. The fault diagnosis method for a multi-screen display system in a new energy vehicle according to claim 6, characterized in that, include: Based on the real-time video stream data source of the vehicle's infotainment system, monitor the screen display status; If the screen displays an abnormal real-time status of the corresponding vehicle infotainment system's video stream, a first diagnostic command will be generated. If the screen output shows an abnormal state corresponding to the first image data, a second diagnostic instruction will be generated. If the data status of the second image output on the screen is abnormal, log data indicating that the current vehicle system diagnostic strategy has failed will be generated.

8. An electronic device, characterized in that, include: The processor, communication interface, memory, and communication bus are connected, with the processor, communication interface, and memory communicating with each other via the communication bus. The memory stores a computer program, which, when executed by a processor, causes the processor to perform the steps of the fault diagnosis method for the multi-screen display system of a new energy vehicle as described in any one of claims 3 to 7.

9. A computer-readable storage medium, characterized in that, The device stores a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the fault diagnosis method for the multi-screen display system of a new energy vehicle as described in any one of claims 3 to 7.

10. A vehicle platform, characterized in that, include: An electronic device for implementing the steps of the fault diagnosis method for a multi-screen display system of a new energy vehicle as described in any one of claims 3 to 7; The processor runs a program, and when the program runs, it executes the steps of the fault diagnosis method for the multi-screen display system of a new energy vehicle as described in any one of claims 3 to 7 from the data output by the electronic device. A storage medium for storing a program that, when running, performs the steps of the fault diagnosis method for the multi-screen display system of a new energy vehicle as described in any one of claims 3 to 7 on data output from an electronic device.

Images