A vehicle display fault acquisition method and device

Abstract

The application discloses a vehicle display fault acquisition method and device. The vehicle display fault acquisition method comprises the following steps: acquiring image information of a first preset position on a combination instrument, which is referred to as combination instrument image information; acquiring image information of a second preset position on a central control display screen, which is referred to as central control display screen image information; judging whether the combination instrument image information and the central control display screen image information are the same; and if not, acquiring fault position information according to the image information of the second preset position on the central control display screen and log data. The vehicle display fault acquisition method firstly captures image features of the combination instrument and the central control display through image recognition and judges whether the information is consistent. And the interface information defined in the application layer and the log data of the system layer are applied to troubleshoot the fault cause, which is simpler and faster than the manual searching mode of the prior art.

Description

Technical Field

[0001] This application relates to the field of vehicle function maintenance and optimization technology, specifically to a method and device for obtaining vehicle display faults. Background Technology

[0002] With the continuous development of intelligent connectivity in the automotive industry, consumers' perception of cars is gradually shifting from "a means of transportation" to a "third space" connecting home and office. The car cabin, as a spatial carrier, is receiving increasing attention from OEMs and auto parts manufacturers. However, the fragmented functional layout of traditional cabins and the poor human-machine interaction experience of mechanical instruments and central control displays fail to meet consumers' demands for intelligent car cabins. Meanwhile, driven by advancements in artificial intelligence, vehicle networking technology, automotive chips, and operating systems, intelligent cabins that offer multi-screen interaction and are centered on human-machine interaction are emerging. An intelligent cabin is a complete system composed of electronic devices such as an in-vehicle entertainment system, digital LCD instrument cluster, head-up display (HUD), streaming rearview mirror, and rear-seat displays. It represents a comprehensive upgrade to the traditional cabin. In terms of hardware, it upgrades traditional mechanical instruments to digital LCD instrument clusters, providing a highly technological visual display of driving information; and adds a streaming rearview mirror, HUD, and rear-seat displays to provide consumers with comprehensive navigation information, surrounding environment information, and entertainment information. In terms of software, it incorporates multimodal interaction, intelligent scenarios, and personalized services to meet diverse human-computer interaction needs and enhance the consumer driving experience.

[0003] However, the more multi-screen interactive functions there are, the greater the risk of malfunctions. In current intelligent displays, the instrument panel in front of the driver also displays navigation information transmitted from the central control screen. However, unlike the central control screen, which is calculated and displayed by the host's application layer, the instrument panel's navigation information is transmitted from the host to the instrument display; the instrument panel only receives the signal. Therefore, testers must simultaneously observe both screen displays during bench testing or real-vehicle testing to determine consistency before the development team analyzes the results. This not only increases the workload during testing but also involves too many competitors' specialties in problem tracing and makes problem analysis overly cumbersome.

[0004] Therefore, there is a need for a technical solution to address or at least mitigate the aforementioned shortcomings of existing technologies. Summary of the Invention

[0005] The purpose of this invention is to provide a method for obtaining vehicle display faults to at least solve one of the above-mentioned technical problems.

[0006] One aspect of the present invention provides a method for obtaining vehicle display faults, the method comprising:

[0007] Acquire image information of a first preset position on the instrument cluster; this image information is referred to as instrument cluster image information.

[0008] Acquire image information from a second preset position on the central control display screen; this image information is referred to as central control display screen image information.

[0009] Determine if the image information from the instrument cluster and the central control display screen are the same. If not, then...

[0010] The fault location information is obtained based on the image information and log data at the second preset position on the central control display screen.

[0011] Optionally, the combined instrument image information and the central control display image information are acquired by taking pictures or by taking screenshots.

[0012] Optionally, determining whether the image information of the instrument cluster and the image information of the central control display screen are the same includes:

[0013] The acquired instrument cluster image information is subjected to image recognition to obtain the instrument cluster image recognition result;

[0014] The acquired image information of the central control display screen is subjected to image recognition to obtain the image recognition result of the central control display screen;

[0015] Compare the image recognition results of the instrument cluster with those of the central control display screen. If they are not the same, then...

[0016] The image information of the instrument cluster and the image information of the central control display screen are different.

[0017] Optionally, the step of performing image recognition on the acquired instrument cluster image information to obtain the instrument cluster image recognition result includes:

[0018] Image features for acquiring combined instrument panel image information;

[0019] Obtain the trained BP neural network;

[0020] The image features are input into the BP neural network to obtain the combined instrument image recognition result.

[0021] Optionally, obtaining the fault location information based on log data includes:

[0022] Theoretical data information is obtained based on the image information at the second preset position on the central control display screen;

[0023] Log data is obtained based on the image information at the first preset position on the instrument cluster.

[0024] The fault location is determined based on the theoretical data and log data.

[0025] Optionally, obtaining log data based on image information at a first preset position on the instrument cluster includes:

[0026] Obtain a preset interface table, which includes at least one preset interface and the preset interface function corresponding to each preset interface;

[0027] The interface function that acquires the image information of the first preset position on the instrument cluster;

[0028] Obtain the preset interface corresponding to the preset interface function that has the same function as the aforementioned interface;

[0029] Retrieve the log data of the preset interface from the vehicle's log.

[0030] Optionally, the log data includes log data transmitted from the application layer to the adaptation layer;

[0031] The theoretical data information includes theoretical data information transmitted from the application layer to the adaptation layer, theoretical data information transmitted from the adaptation layer to the system layer, and theoretical data information transmitted from the system layer to the combined instrument.

[0032] The process of obtaining the fault location based on the theoretical data and log data includes:

[0033] Determine whether the log data transmitted from the application layer to the adaptation layer is the same as the theoretical data information transmitted from the application layer to the adaptation layer. If not, determine that the fault location information is from the application layer.

[0034] Optionally, the log data includes log data transmitted from the adaptation layer to the system layer;

[0035] The theoretical data information includes the theoretical data information transmitted from the adaptation layer to the system layer;

[0036] The step of obtaining the fault location based on the theoretical data information and log data further includes:

[0037] Determine whether the log data transmitted from the application layer to the adaptation layer is the same as the theoretical data information transmitted from the application layer to the adaptation layer. If so, then...

[0038] Determine whether the log data transmitted by the adaptation layer to the system layer is the same as the theoretical data information transmitted by the adaptation layer to the system layer. If not, determine that the fault location information is from the adaptation layer.

[0039] Optionally, the log data includes log data transmitted from the system layer to the combined instrument;

[0040] The theoretical data information includes the theoretical data information transmitted from the system layer to the combined instrument;

[0041] The step of obtaining the fault location based on the theoretical data information and log data further includes:

[0042] Determine whether the log data transmitted by the adaptation layer to the system layer is the same as the theoretical data information transmitted by the adaptation layer to the system layer. If so, then...

[0043] Determine whether the log data transmitted from the system layer to the instrument cluster is the same as the theoretical data information transmitted from the system layer to the instrument cluster. If not, determine that the fault location information is from the system layer.

[0044] This application also provides a vehicle display fault acquisition device, the vehicle display fault acquisition device comprising:

[0045] The first image information acquisition module is used to acquire image information at a first preset position on the instrument cluster, and the image information is called instrument cluster image information.

[0046] The second image information acquisition module is used to acquire image information at a second preset position on the central control display screen, and this image information is referred to as central control display screen image information.

[0047] The judgment module is used to determine whether the image information of the instrument cluster and the image information of the central control display screen are the same;

[0048] The fault location information acquisition module is used to acquire fault location information based on image information and log data at a second preset location on the central control display screen when the judgment module determines that it is not.

[0049] The beneficial effects of this application are as follows:

[0050] The vehicle display fault acquisition method of this application first captures image features from the instrument cluster and central control display using image recognition and determines whether the information is consistent. Then, it uses interface information defined in the application layer and log data in the system layer to troubleshoot the cause of the fault, which is simpler and faster than the manual search method in existing technologies. Attached Figure Description

[0051] Figure 1 This is a schematic flowchart of a vehicle display fault acquisition method according to an embodiment of this application.

[0052] Figure 2 This is a schematic diagram of an electronic device capable of implementing the vehicle model benchmarking function reference method of an embodiment of this application.

[0053] Figure 3 This is a schematic diagram of the navigation function according to an embodiment of this application.

[0054] Figure 4 This is a schematic diagram of the software architecture of an embodiment of this application.

[0055] Figure 5 This is a schematic diagram of a log file according to an embodiment of this application. Detailed Implementation

[0056] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions in the embodiments of this application will be described in more detail below with reference to the accompanying drawings. In the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are some, but not all, embodiments of this application. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application. The embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0057] Figure 1 This is a schematic flowchart of a vehicle display fault acquisition method according to an embodiment of this application.

[0058] like Figure 1 The methods for obtaining vehicle display faults shown include:

[0059] Step 1: Obtain image information of the first preset position on the instrument cluster. This image information is called the instrument cluster image information.

[0060] Step 2: Obtain image information from the second preset position on the central control display screen; this image information is referred to as the central control display screen image information.

[0061] Step 3: Determine if the image information from the instrument cluster and the central control display screen are the same. If not, then...

[0062] Step 4: Obtain the fault location information based on the image information and log data at the second preset position on the central control display screen.

[0063] The vehicle display fault acquisition method of this application first captures image features from the instrument cluster and central control display using image recognition and determines whether the information is consistent. Then, it uses interface information defined in the application layer and log data in the system layer to troubleshoot the cause of the fault, which is simpler and faster than the manual search method in existing technologies.

[0064] In this embodiment, the combined instrument image information and the central control display image information are obtained by image capture or by screenshot.

[0065] In this embodiment, determining whether the combined instrument panel image information and the central control display screen image information are the same includes:

[0066] The acquired instrument cluster image information is subjected to image recognition to obtain the instrument cluster image recognition result;

[0067] The acquired image information of the central control display screen is subjected to image recognition to obtain the image recognition result of the central control display screen;

[0068] Compare the image recognition results of the instrument cluster with those of the central control display screen. If they are not the same, then...

[0069] The image information of the instrument cluster and the image information of the central control display screen are different.

[0070] In this embodiment, the step of performing image recognition on the acquired instrument cluster image information to obtain the instrument cluster image recognition result includes:

[0071] Image features for acquiring combined instrument panel image information;

[0072] Obtain the trained BP neural network;

[0073] The image features are input into the BP neural network to obtain the combined instrument image recognition result.

[0074] In this embodiment, obtaining the fault location information based on log data includes:

[0075] Theoretical data information is obtained based on the image information at the second preset position on the central control display screen;

[0076] Log data is obtained based on the image information at the first preset position on the instrument cluster.

[0077] The fault location is determined based on the theoretical data and log data.

[0078] In this embodiment, obtaining log data based on image information at a first preset position on the instrument cluster includes:

[0079] Obtain a preset interface table, which includes at least one preset interface and the preset interface function corresponding to each preset interface;

[0080] The interface function that acquires the image information of the first preset position on the instrument cluster;

[0081] Obtain the preset interface corresponding to the preset interface function that has the same function as the aforementioned interface;

[0082] Retrieve the log data of the preset interface from the vehicle's log.

[0083] In this embodiment, the log data includes the log data transmitted from the application layer to the adaptation layer;

[0084] The theoretical data information includes theoretical data information transmitted from the application layer to the adaptation layer, theoretical data information transmitted from the adaptation layer to the system layer, and theoretical data information transmitted from the system layer to the combined instrument.

[0085] The process of obtaining the fault location based on the theoretical data and log data includes:

[0086] Determine whether the log data transmitted from the application layer to the adaptation layer is the same as the theoretical data information transmitted from the application layer to the adaptation layer. If not, determine that the fault location information is from the application layer.

[0087] In this embodiment, the log data includes the log data transmitted from the adaptation layer to the system layer;

[0088] The theoretical data information includes the theoretical data information transmitted from the adaptation layer to the system layer;

[0089] The step of obtaining the fault location based on the theoretical data information and log data further includes:

[0090] Determine whether the log data transmitted from the application layer to the adaptation layer is the same as the theoretical data information transmitted from the application layer to the adaptation layer. If so, then...

[0091] Determine whether the log data transmitted by the adaptation layer to the system layer is the same as the theoretical data information transmitted by the adaptation layer to the system layer. If not, determine that the fault location information is from the adaptation layer.

[0092] In this embodiment, the log data includes the log data transmitted from the system layer to the combined instrument;

[0093] The theoretical data information includes the theoretical data information transmitted from the system layer to the combined instrument;

[0094] The step of obtaining the fault location based on the theoretical data information and log data further includes:

[0095] Determine whether the log data transmitted by the adaptation layer to the system layer is the same as the theoretical data information transmitted by the adaptation layer to the system layer. If so, then...

[0096] Determine whether the log data transmitted from the system layer to the instrument cluster is the same as the theoretical data information transmitted from the system layer to the instrument cluster. If not, determine that the fault location information is from the system layer.

[0097] The following examples further illustrate this application in detail. It is understood that these examples do not constitute any limitation on this application.

[0098] See Figures 3 to 5 In this embodiment, with Figure 3 Taking the navigation function shown as an example, in the embodiments of this application, the first preset position on the instrument cluster displays a left turn icon, while the second preset position on the central control display screen displays a right turn icon. The method of this application can identify that the contents displayed on the instrument cluster and the central control display screen are different.

[0099] In this embodiment, the screenshot is first set to `im = pyautogui.screenshot()`, and different capture ranges are defined. The position shown in the screenshot is then compared with 26 pieces of information defined in the established communication protocol. Figure 3 (The screenshot location can be defined by the user.) Using pytesseract in Python for text and image recognition, it returns a list of information based on the currently displayed number and the direction of the image.

[0100] Configure ListIC and ListIVI on the instrument panel. After obtaining the information displayed on the instrument panel and central control unit, compare the displayed information to determine whether the two displays are the same. If they are the same, it means that the function is normal. If they are different, it means that there is a fault.

[0101] When the display is different, the fault location information is obtained based on the image information of the second preset position on the central control display screen and the log data.

[0102] The specific method is as follows:

[0103] Theoretical data information is obtained based on the image information at the second preset position on the central control display screen;

[0104] Log data is obtained based on the image information at the first preset position on the instrument cluster.

[0105] The fault location is determined based on the theoretical data and log data.

[0106] In this embodiment, the image on the central control display screen is assumed to be the correct image, meaning that the theoretical data information of the image can be obtained through the image on the central control display screen, such as... Figure 3As shown, the central control display shows a right turn, meaning the theoretical data information should be the number 3 corresponding to a right turn. As for the interface, it can be determined according to the preset interface table. For example, the interface corresponding to a right turn is interface 1113. This interface table is preset by the user based on the vehicle model and will not be elaborated on here.

[0107] In this embodiment, knowing the specific interface, it is only necessary to find the corresponding interface (for example, this application needs to obtain the log corresponding to interface 1113) from the vehicle system log. Figure 5 This can be defined as a specific representation of a log entry.

[0108] In this embodiment, the navigation signal transmission link is through the application layer in the entertainment host, to the adaptation layer, and then to the system layer. The system layer then transmits the signal to the instrument panel, which then displays it. For the specific software architecture, please refer to [link to software architecture]. Figure 4 .

[0109] In this embodiment, the right-turn icon information sent by the original entertainment host (i.e. Figure 3 There are three places where errors occur: during the transmission from the application layer to the adaptation layer, during the transmission from the adaptation layer to the system layer, and during the transmission from the system layer to the instrument. Therefore, we only need to find out which layer is transmitting the wrong data by checking the log data.

[0110] For example, theoretically, the application layer should pass 3 to the adaptation layer, but if it passes 2 instead, then there is a problem in the application layer. Similarly, if the adaptation layer passes an error to the system layer, then there is a problem in the adaptation layer.

[0111] For example, when the adaptation layer is passed to the system layer, it will also be passed according to the interface definition, as shown in Table 1.

[0112] Table 1 Functional Interfaces

[0113]

[0114]

[0115] The table above defines some of the functional interfaces. During data transmission, both navigation designers and system designers send data according to this list. When detecting problems, the current interface parameters can be determined through the logs. By detecting inconsistencies between the two ends, the corresponding functions and their defined interfaces can be found, and the transmitted parameters can be located in the vehicle's infotainment logs. The vehicle's logs are as follows: Figure 5 .

[0116] The log file shows the corresponding API, time, and parameters for each function. By matching the APIs in the log file with those defined in the API table, and comparing the passed parameters with the defined parameters, we can determine whether the passed parameters match the defined API parameters; if not, it means they are different.

[0117] In this embodiment, the function of the automatic vehicle navigation system is to calculate the driving route based on the vehicle's current location provided by the GPS receiver, the user-inputted destination, and an electronic map, and to provide this information to the driver while driving. Currently, autonomous navigation is the most widely used system globally. Its main characteristic is that each in-vehicle navigation device comes with its own electronic map, and all positioning and navigation functions are performed by the in-vehicle equipment. Its working process mainly includes the following steps:

[0118] I. Inputting Data. Before setting off, the driver inputs the destination into the navigation device, either by directly clicking to select a location on the system's electronic map or by using a different input method to enter the destination name into the system. Depending on the input device, different location name input methods are available, and almost all operation functions can be achieved using buttons or a touchscreen. For added convenience, products utilizing voice recognition technology are also currently under development.

[0119] II. Displaying Electronic Maps. A crucial component of a car navigation system is the electronic map stored on a CD or internal memory (such as a hard drive). This electronic map stores geographical, road, and traffic control information within a specific area, along with corresponding latitude and longitude coordinates. The car navigation unit obtains the calculated latitude and longitude of the current point from the GPS receiver and compares it with the electronic map data to determine the vehicle's current location in real time.

[0120] Most car navigation systems default to the vehicle's current location as the starting point. After the user enters the destination, the system automatically calculates the most suitable recommended route based on map information stored on the electronic map. Some systems allow users to specify desired waypoints or route selection rules (such as prohibiting highways or following the shortest route). The recommended route is prominently displayed on the map on the screen, which also continuously shows the vehicle's current location for reference. If the vehicle deviates from the recommended route during travel, the system automatically deletes the original route and recalculates the route from the vehicle's current starting point, using the corrected route as the new recommended route.

[0121] The logger is the core component of log processing. log4j has 5 normal levels.

[0122] 1. Static Level DEBUG: DEBUG Level indicates fine-grained information events, which is very helpful for debugging applications. Generally, if the execution of a method is considered important and requires detailed observation of its running status, then debug should be enabled.

[0123] 2. Static Level INFO: INFO level indicates that the message highlights the application's execution process at a coarse-grained level. It can be used to determine whether a method is running.

[0124] 3. Static Level WARN: WARN level indicates a potential error situation.

[0125] 4. Static Level ERROR: The ERROR level indicates that although an error event has occurred, it does not affect the continued operation of the system. ERROR is generally required for exception handling and other similar situations.

[0126] 5. Static Level FATAL: The FATAL level indicates which critical error event will cause the application to exit.

[0127] In addition, there are two special logging levels available:

[0128] 1. static Level ALL: ALL Level is the lowest level and is used to enable all logging.

[0129] 2. Static Level OFF: OFF Level is the highest level and is used to turn off all logging.

[0130] By defining the levels here, you can control the on / off state of logging at the corresponding levels in your application. For example, if you define the INFO level here, then all DEBUG level log messages in the application will not be printed.

[0131] High-priority logs will be printed. When deploying the project to a production environment, it is recommended to reset the debug log level to warn or higher to avoid generating a large number of logs.

[0132] The vehicle display fault acquisition method of this application can automatically compare navigation display information in multi-screen interaction. When the display is inconsistent, it analyzes the cause of the fault through the interface definition and data transmission between the application layer, adaptation layer and system layer, and finally presents the sorted data to the designer to help the designer to observe the data more intuitively, while saving the time and cost of testing and development.

[0133] This application also provides a vehicle display fault acquisition device, which includes a first image information acquisition module, a second image information acquisition module, a judgment module, and a fault location information acquisition module. The first image information acquisition module is used to acquire image information of a first preset position on the instrument cluster, which is called instrument cluster image information. The second image acquisition module is used to acquire image information of a second preset position on the central control display screen, which is called central control display screen image information. The judgment module is used to determine whether the instrument cluster image information and the central control display screen image information are the same. When the judgment module determines that the fault location information is not the same, the fault location information acquisition module is used to acquire fault location information based on the image information of the second preset position on the central control display screen and log data.

[0134] It is understandable that the above description of the method also applies to the description of the apparatus.

[0135] This application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, wherein the processor executes the computer program to implement the above-described vehicle display fault acquisition method.

[0136] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, can implement the above-described method for obtaining vehicle display faults.

[0137] Figure 2 This is an exemplary structural diagram of an electronic device capable of implementing the vehicle display fault acquisition method provided in one embodiment of this application.

[0138] like Figure 2 As shown, the electronic device includes an input device 501, an input interface 502, a central processing unit 503, a memory 504, an output interface 505, and an output device 506. The input interface 502, central processing unit 503, memory 504, and output interface 505 are interconnected via a bus 507. The input device 501 and output device 506 are connected to the bus 507 via the input interface 502 and output interface 505, respectively, and thus connected to other components of the electronic device. Specifically, the input device 504 receives input information from the outside and transmits it to the central processing unit 503 via the input interface 502. The central processing unit 503 processes the input information based on computer-executable instructions stored in the memory 504 to generate output information, temporarily or permanently storing the output information in the memory 504, and then transmitting the output information to the output device 506 via the output interface 505. The output device 506 outputs the output information to the outside of the electronic device for user use.

[0139] In other words, Figure 2 The illustrated electronic device may also be implemented as including: a memory storing computer-executable instructions; and one or more processors, which can be coupled when executing the computer-executable instructions. Figure 1 The method described is for obtaining vehicle display faults.

[0140] In one embodiment, Figure 2 The electronic device shown can be implemented to include: a memory 504 configured to store executable program code; and one or more processors 503 configured to run the executable program code stored in the memory 504 to perform the vehicle display fault acquisition method in the above embodiments.

[0141] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0142] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0143] Computer-readable media include both permanent and non-permanent, removable and non-removable media, and information storage can be achieved by any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, DVD or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transfer medium that can be used to store information accessible by a computing device.

[0144] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0145] Furthermore, it is clear that the word "comprising" does not exclude other units or steps. Multiple units, modules, or devices recited in the apparatus claims may also be implemented by a single unit or overall apparatus via software or hardware.

[0146] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code, which includes one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutively marked blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or the overall flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0147] In this embodiment, the processor may be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0148] Memory can be used to store computer programs and / or modules. The processor implements various functions of the device / terminal equipment by running or executing the computer programs and / or modules stored in the memory, and by accessing data stored in the memory. Memory can mainly include a program storage area and a data storage area. The program storage area can store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area can store data created based on the use of the mobile phone (such as audio data, phonebook, etc.). In addition, memory can include high-speed random access memory, and can also include non-volatile memory, such as hard disk, RAM, plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0149] In this embodiment, if the modules / units integrated into the device / terminal equipment are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of the present invention can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. Although this application discloses preferred embodiments as described above, it is not intended to limit this application. Any person skilled in the art can make possible changes and modifications without departing from the spirit and scope of this application. Therefore, the scope of protection of this application should be determined by the scope defined in the claims of this application.

[0150] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0151] Furthermore, it is clear that the word "comprising" does not exclude other units or steps. Multiple units, modules, or devices recited in the apparatus claims may also be implemented by a single unit or overall apparatus via software or hardware.

[0152] Although the present invention has been described in detail above with general descriptions and specific embodiments, modifications or improvements can be made to it, which will be obvious to those skilled in the art. Therefore, all such modifications or improvements made without departing from the spirit of the present invention are within the scope of protection claimed by the present invention.

Claims

1. A method for obtaining vehicle display faults, characterized in that, The method for obtaining vehicle display faults includes: Acquire image information of a first preset position on the instrument cluster; this image information is referred to as instrument cluster image information. Acquire image information from a second preset position on the central control display screen; this image information is referred to as central control display screen image information. Determine if the image information from the instrument cluster and the central control display screen are the same. If not, then... The fault location information is obtained based on the image information and log data at the second preset position on the central control display screen. Among them, obtaining fault location information based on log data includes: Theoretical data information is obtained based on the image information at the second preset position on the central control display screen; Log data is obtained based on the image information at the first preset position on the instrument cluster. The fault location is determined based on the theoretical data and log data. The step of obtaining log data based on image information at a first preset position on the instrument cluster includes: Obtain a preset interface table, which includes at least one preset interface and the preset interface function corresponding to each preset interface; The interface function that acquires the image information of the first preset position on the instrument cluster; Obtain the preset interface corresponding to the preset interface function that has the same function as the aforementioned interface; Retrieve the log data of the preset interface from the vehicle's log.

2. The vehicle display fault acquisition method as described in claim 1, characterized in that, The combined instrument panel image information and the central control display screen image information are obtained by image capture or by screenshot.

3. The vehicle display fault acquisition method as described in claim 2, characterized in that, The determination of whether the combined instrument panel image information and the central control display screen image information are the same includes: The acquired instrument cluster image information is subjected to image recognition to obtain the instrument cluster image recognition result; The acquired image information of the central control display screen is subjected to image recognition to obtain the image recognition result of the central control display screen; Compare the image recognition results of the instrument cluster with those of the central control display screen. If they are not the same, then... The image information of the instrument cluster and the image information of the central control display screen are different.

4. The vehicle display fault acquisition method as described in claim 3, characterized in that, The step of performing image recognition on the acquired instrument cluster image information to obtain the instrument cluster image recognition result includes: Image features for acquiring combined instrument panel image information; Obtain the trained BP neural network; The image features are input into the BP neural network to obtain the combined instrument image recognition result.

5. The vehicle display fault acquisition method as described in claim 1, characterized in that, The log data includes the log data passed from the application layer to the adaptation layer; The theoretical data information includes theoretical data information transmitted from the application layer to the adaptation layer, theoretical data information transmitted from the adaptation layer to the system layer, and theoretical data information transmitted from the system layer to the combined instrument. The process of obtaining the fault location based on the theoretical data and log data includes: Determine whether the log data transmitted from the application layer to the adaptation layer is the same as the theoretical data information transmitted from the application layer to the adaptation layer. If not, determine that the fault location information is from the application layer.

6. The vehicle display fault acquisition method as described in claim 5, characterized in that, The log data includes the log data transmitted from the adaptation layer to the system layer; The theoretical data information includes the theoretical data information transmitted from the adaptation layer to the system layer; The step of obtaining the fault location based on the theoretical data information and log data further includes: Determine whether the log data transmitted from the application layer to the adaptation layer is the same as the theoretical data information transmitted from the application layer to the adaptation layer. If so, then... Determine whether the log data transmitted by the adaptation layer to the system layer is the same as the theoretical data information transmitted by the adaptation layer to the system layer. If not, determine that the fault location information is from the adaptation layer.

7. The vehicle display fault acquisition method as described in claim 6, characterized in that, The log data includes the log data transmitted from the system layer to the combined instrument; The theoretical data information includes the theoretical data information transmitted from the system layer to the combined instrument; The step of obtaining the fault location based on the theoretical data information and log data further includes: Determine whether the log data transmitted by the adaptation layer to the system layer is the same as the theoretical data information transmitted by the adaptation layer to the system layer. If so, then... Determine whether the log data transmitted from the system layer to the instrument cluster is the same as the theoretical data information transmitted from the system layer to the instrument cluster. If not, determine that the fault location information is from the system layer.

8. A vehicle fault display acquisition device, characterized in that, Used to perform the vehicle display fault acquisition method according to any one of claims 1-7; The vehicle fault display acquisition device includes: The first image information acquisition module is used to acquire image information at a first preset position on the instrument cluster, and the image information is called instrument cluster image information. The second image information acquisition module is used to acquire image information at a second preset position on the central control display screen, and this image information is referred to as central control display screen image information. The judgment module is used to determine whether the image information of the instrument cluster and the image information of the central control display screen are the same; The fault location information acquisition module is used to acquire fault location information based on image information and log data at a second preset location on the central control display screen when the judgment module determines that it is not.

Images