Fault display method, vehicle, equipment and storage medium

Abstract

The invention relates to the technical field of vehicles, in particular to a fault display method, a vehicle, equipment and a storage medium. The method comprises the steps of obtaining fault information of a vehicle; based on the fault information, obtaining a fault sub-model of a fault component in the vehicle; the fault sub-model is combined to a three-dimensional frame model of the overall frame of the vehicle, the combined three-dimensional frame model is displayed, the three-dimensional frame model comprises sub-models corresponding to all vehicle parts of the vehicle, and the display effect of the fault sub-model is different from that of the three-dimensional frame model. According to the invention, based on the three-dimensional technology, the fault part of the vehicle can be displayed for the user more efficiently and visually.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a fault display method, vehicle, device and storage medium. Background Art

[0002] With the rapid development of automobile technology, the level of vehicle intelligence and networking has also increased rapidly. However, the increase in system complexity and integration has also brought challenges to fault detection and processing. Traditional vehicle fault detection methods often rely on professional fault diagnosis equipment and technicians, which not only increases the user's maintenance costs, but also prolongs the time to solve the fault. The application of three-dimensional (3D) technology in the field of vehicle design and manufacturing has been relatively mature. Although 3D technology has been used to present vehicle fault conditions, when displaying vehicle faults based on 3D technology, display efficiency and intuitiveness are important factors affecting user experience. How to display vehicle fault conditions to users more efficiently and intuitively has become an important topic for technology improvement. Summary of the invention

[0003] Based on the above-mentioned defects and shortcomings of the prior art, the present application proposes a fault display method, vehicle, equipment and storage medium, which can display the faulty parts of the vehicle to users more efficiently and intuitively based on three-dimensional technology.

[0004] According to the first aspect of the present application, a fault display method is provided, comprising: obtaining fault information of a vehicle; based on the fault information, obtaining a fault sub-model of a faulty component in the vehicle; combining the fault sub-model with a three-dimensional frame model of the overall frame of the vehicle, and displaying the combined three-dimensional frame model, wherein the three-dimensional frame model includes sub-models corresponding to each vehicle component of the vehicle, and the display effects of the fault sub-model and the three-dimensional frame model are different.

[0005] According to the fault display method provided in the first aspect of the present application, the fault sub-model of the faulty component in the vehicle is obtained based on the fault information, including: querying a model library to obtain a target template fault model corresponding to the fault information, wherein the model library includes at least one three-dimensional template fault model, each of which corresponds to one of the vehicle components; and determining that the target template fault model is the fault sub-model.

[0006] According to the fault display method provided in the first aspect of the present application, the fault information includes a fault type and a fault location; the query model library is used to obtain a target template fault model corresponding to the fault information, including: determining the vehicle component that has failed in the vehicle based on the fault location; obtaining the fault level corresponding to the fault type; querying the model library to determine the component identification of the vehicle component and the target template fault model corresponding to the fault level, wherein the fault levels of the same vehicle component in the model library are different, and the display effect of the template fault model is different.

[0007] According to the fault display method provided in the first aspect of the present application, each of the template fault models in the model library includes corresponding fault troubleshooting information; the display of the three-dimensional framework model after combined processing includes: displaying the three-dimensional framework model after combined processing, and displaying the fault troubleshooting information.

[0008] According to the fault display method provided in the first aspect of the present application, the fault troubleshooting information includes animation data for indicating fault troubleshooting; the display of the three-dimensional framework model after the combination processing, and the display of the fault troubleshooting information include: when displaying the three-dimensional framework model after the combination processing, dynamically displaying the fault troubleshooting information based on the animation data.

[0009] According to the fault display method provided in the first aspect of the present application, the method also includes: obtaining update data of the template fault model, wherein the update data includes modification data, new data and / or deletion data of the template fault model; based on the update data, updating the template fault model in the model library.

[0010] According to the fault display method provided in the first aspect of the present application, the display of the three-dimensional frame model after the combination processing includes: when a fault display instruction is received, displaying the three-dimensional frame model after the combination processing, wherein the fault display instruction includes a trigger instruction or a voice instruction instructing the fault display.

[0011] According to a second aspect of the present application, a vehicle is provided, comprising a display module; the display module is used to display a fault sub-model and a three-dimensional framework model obtained by the fault display method described in any one of the first aspects.

[0012] According to a third aspect of the present application, an electronic device is provided, comprising: a memory and a processor; the memory is connected to the processor and is used to store programs; the processor is used to implement the fault display method as described in the first aspect by running the program in the memory.

[0013] According to a fourth aspect of the present application, a computer program product is provided, comprising computer program instructions; when the computer program instructions are executed by a processor, the processor is enabled to execute the fault display method as described in the first aspect.

[0014] In the present application, the fault information of the vehicle is obtained; based on the fault information, the fault sub-model of the faulty component in the vehicle is obtained; the fault sub-model is combined with the three-dimensional frame model of the overall frame of the vehicle, and the combined three-dimensional frame model is displayed, wherein the three-dimensional frame model includes sub-models corresponding to each component of the vehicle, and the display effects of the fault sub-model and the three-dimensional frame model are different. In the above process, the three-dimensional frame model of the vehicle includes sub-models corresponding to each vehicle component, and when a certain vehicle component of the vehicle fails, the fault sub-model corresponding to the faulty component is combined with the three-dimensional frame model, thereby realizing modular processing of vehicle fault display, which is more efficient than directly processing the three-dimensional model of the whole vehicle. At the same time, based on the modular display, the fault sub-model and the three-dimensional frame model have different display effects, and the user can more intuitively see the relationship between the faulty component and the whole vehicle, so that the user can more easily and quickly understand the fault condition of the vehicle, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0016] Figure 1 A flowchart of a fault display method provided in an embodiment of the present application;

[0017] Figure 2 An example diagram of the display effect of a fault sub-model and a three-dimensional framework model provided in an embodiment of the present application;

[0018] Figure 3 A schematic diagram of communication between multiple controllers in a vehicle provided in an embodiment of the present application;

[0019] Figure 4 A schematic diagram of the process of vehicle fault detection and three-dimensional fault display provided in an embodiment of the present application;

[0020] Figure 5 A block diagram of a fault display device provided in an embodiment of the present application;

[0021] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0023] Application Overview

[0024] The application of three-dimensional (3D) technology in the field of vehicle design and manufacturing has become relatively mature, but its application in vehicle fault detection is still in its infancy. By presenting vehicle fault conditions through 3D vehicle models, complex fault information can be presented to users in an intuitive and easy-to-understand manner, thereby helping users better understand the fault conditions and even achieve self-service troubleshooting. In addition, with the popularization and performance improvement of vehicle-mounted central control screens, it has become possible to integrate 3D vehicle models into vehicle-mounted systems to provide users with a more convenient and efficient fault detection experience.

[0025] In the existing technology, although some technical solutions mention the remote detection and 3D visualization of vehicle faults, it is usually necessary to send the fault information to the vehicle-side display device through the cloud, rather than directly viewing it on the vehicle's central control screen, which limits the user's instant interactive experience during driving and increases the complexity and inconvenience of operation. At the same time, the self-service troubleshooting function is insufficient and lacks detailed self-service troubleshooting steps and guidance. This means that users still need to rely on professional technicians or conduct complex queries to resolve the fault, reducing the practicality and efficiency of self-service troubleshooting. In addition, data synchronization and update delays may cause a certain delay in the fault information seen by the user, which cannot immediately reflect the current true status of the vehicle. Secondly,

[0026] However, traditional automobile fault detection methods are not user-friendly, the operations are complex and time-consuming, and the fault handling process is cumbersome and requires professional support. Specifically, first of all, the existing traditional fault monitoring methods cannot guarantee the intuitiveness and immediacy of fault detection, and often rely on professional fault diagnosis equipment and technicians. It is difficult for users to understand the vehicle fault situation intuitively and immediately. Secondly, the threshold for troubleshooting with traditional fault monitoring methods is high, requiring users to have certain professional knowledge or rely on professional technicians. Thirdly, traditional fault monitoring methods have poor user experience. Thirdly, traditional fault monitoring methods have high system complexity and cost. Finally, if traditional fault monitoring methods use cloud-based automatic processing, data privacy and security need to be improved.

[0027] Exemplary Methods

[0028] In view of the problems existing in the prior art, the present application provides a fault display method. The fault display method is implemented by a software algorithm, and the software algorithm can be implemented on any device with processing function, and optionally, the device can be an on-board processor.

[0029] In one embodiment, if Figure 1 As shown, the process steps for implementing the fault display method include:

[0030] Step 101, obtaining vehicle fault information.

[0031] In this embodiment, after a vehicle fails, the vehicle-mounted system can monitor the failure and collect the vehicle's failure information, which includes one or more types of failure-related information such as whether a failure exists, the type of failure, and the location of the failure. Specifically, the vehicle-side data acquisition module continuously monitors the operating status of each vehicle component in the vehicle through various sensors installed on the vehicle, such as the engine speed sensor, oil temperature sensor, and tire pressure sensor. The data analysis unit performs feature extraction after filtering and denoising the data collected by each sensor, and then uses a pre-set fault detection algorithm to determine whether the vehicle has a failure. Optionally, the pre-set fault detection algorithm can be a neural network model that has been trained in advance, and can also be based on a preset fault threshold and a comparison with the vehicle's preset standard data. The fault monitoring algorithm can determine whether a vehicle component on the vehicle has a failure, the location of the failure (or the vehicle component where the failure is located), and the type of failure, so that the fault information can be used for subsequent fault display.

[0032] Step 102: Based on the fault information, a fault sub-model of the faulty component in the vehicle is obtained.

[0033] In this embodiment, the faulty component is a component on the vehicle that has failed, and the fault sub-model is a three-dimensional model of the faulty component, which can intuitively indicate that the faulty component is a faulty vehicle component. The fault sub-model can be a pre-configured three-dimensional template model corresponding to the fault information, or a three-dimensional model generated in real time based on the fault information.

[0034] Step 103, combining the fault sub-model with the three-dimensional frame model of the vehicle's overall frame, and displaying the combined three-dimensional frame model, wherein the three-dimensional frame model includes sub-models corresponding to various vehicle components of the vehicle, and the display effects of the fault sub-model and the three-dimensional frame model are different.

[0035] In this embodiment, the three-dimensional frame model is a three-dimensional model of the vehicle's overall frame, and the three-dimensional frame model is composed of sub-models corresponding to each vehicle component in the vehicle, and each sub-model is a three-dimensional model of the corresponding vehicle component. The three-dimensional frame model is a three-dimensional model when all vehicle components in the vehicle are fault-free, and each sub-model in the three-dimensional frame model does not include any fault information. In order to more intuitively display the vehicle fault, the fault sub-model corresponding to the faulty component is combined with the three-dimensional frame model. Optionally, the sub-model corresponding to the faulty component in the three-dimensional frame model is replaced with the fault sub-model, thereby realizing the combination of the fault sub-model and the three-dimensional frame model.

[0036] In this embodiment, the display effects of the fault sub-model and the three-dimensional framework model are different, and the display effects include transparency, color, line linearity and other effects. Optionally, the three-dimensional framework model is displayed in a semi-transparent manner; the fault sub-model can be displayed in different colors according to the fault level corresponding to the faulty component, and the user can observe the faulty component from multiple angles through operations such as rotation and scaling; the three-dimensional framework model is displayed in a semi-transparent manner, and the fault sub-model is displayed in different colors, which not only retains the integrity of the vehicle structure, but also highlights the faulty component, and the semi-transparent three-dimensional framework model not only allows the user to clearly see the spatial relationship between the faulty component and the entire vehicle, but also avoids the occlusion of the faulty component by the overall structure of the vehicle, and the user can view the faulty component from multiple angles, thereby improving the accuracy of the user's determination of the faulty component through the three-dimensional model. For example, Figure 2 As shown, through analysis, it is determined that the tire pressure of the right front wheel of the vehicle is abnormal. The tire pressure of the right front wheel is 1.7 bar, which is significantly lower than the normal tire pressure of 2.3 bar of the other three wheels. Therefore, while the 3D frame model of the vehicle is displayed in a semi-transparent effect, the right front wheel is displayed in red to highlight the faulty right front wheel. Figure 2 The virtual button in the upper right corner is used to adjust the display angle of the 3D frame model. Figure 2 The virtual back button below is used by users to highlight the three-dimensional display interface.

[0037] In one embodiment, when the vehicle is not faulty, the 3D framework model can also be displayed to the user, and the functions of various vehicle components can be controlled through the 3D framework model. Specifically, the overall status of the vehicle is displayed in real time through the 3D framework model, for example, the opening or closing of vehicle components such as lights, doors, windows, and trunks. The user can adjust the spatial display angle of the 3D framework model to more clearly see the layout of the interior and exterior of the vehicle, as well as the position and status of various vehicle components.

[0038] In this embodiment, the user is allowed to control the functions of various vehicle components by clicking or dragging the corresponding positions of each sub-model on the three-dimensional framework model. For example, by operating the corresponding sub-model, the air conditioning temperature or air volume can be adjusted, the seat angle, heating temperature or ventilation function can be adjusted, the volume of the audio system can be controlled or the track switching can be controlled.

[0039] In this embodiment, based on modular thinking, the three-dimensional framework model is split into multiple high-precision sub-models such as the body shell, engine, and tire, and each vehicle component is dynamically loaded and displayed according to the user's interactive behavior and preset logic. Compared with the low-precision model with a low number of faces that is often used in the current three-dimensional body display, which is displayed with material mapping, there are problems such as unsatisfactory model detail processing and unrealistic visual effects. This application adopts a modular high-precision three-dimensional framework model. Based on the modular three-dimensional framework model, the sub-models corresponding to each vehicle component use high-precision models with a high number of faces. At the same time, based on the display perspective, when the display perspective is the outside of the vehicle, only the high-precision vehicle shell model is displayed, while the chassis, interior and other parts can be displayed through mapping effects, and the remaining vehicle parts that the user cannot see are not displayed. At this time, the processing device only processes the high-precision model of the visible vehicle parts; when the display perspective is switched to the inside of the vehicle, the sub-models corresponding to non-visual vehicle parts such as the body and tires are not displayed, and only the sub-models of the visible vehicle parts visible from the internal perspective are displayed. Through this processing method, not only can the visual effect of the high-precision model be guaranteed, but also the calculation pressure of the processing device can be reduced, and the computing power requirements for the processing device can be reduced.

[0040] In this embodiment, when a vehicle breaks down and the fault sub-model needs to be displayed, based on the obtained three-dimensional framework model after combined processing, the user's perspective is switched from the real-time perspective of the three-dimensional framework model to the display perspective of the fault sub-model through a smooth transition animation, achieving a one-shot effect, ensuring the smoothness and naturalness of the switching process, improving the continuity and immersion of the user experience, reducing the time spent by the user in finding faulty parts, and improving the efficiency of troubleshooting.

[0041] In one embodiment, based on fault information, a fault sub-model of a faulty component in a vehicle is obtained, including: querying a model library to obtain a target template fault model corresponding to the fault information, wherein the model library includes at least one three-dimensional template fault model, and each template fault model corresponds to a vehicle component; determining the target template fault model as a fault sub-model.

[0042] In this embodiment, in order to further improve the intuitiveness and efficiency of fault display, a pre-built model library is used. According to the different components and common fault types of the vehicle, a fine division is performed, and multiple template fault models are pre-configured in the model library, and the model library is stored in the local storage of the vehicle-side device. When a vehicle fails, the corresponding target template fault model can be quickly retrieved from the model library as a fault sub-model based on the fault information, and the combined and processed three-dimensional framework model can be quickly obtained for display. This method avoids the complexity and performance consumption of real-time modeling and rendering, and ensures the fast and accurate display of fault information. Optionally, the processing device for implementing this method is a processor of the vehicle's central control system, and the processor can use a higher performance processor so that it can independently complete the processing of fault data and the display of the three-dimensional framework model.

[0043] In this embodiment, by integrating the core functions of fault detection and three-dimensional model display into the local vehicle, local processing and real-time display of fault information are achieved. Compared with the existing technology that relies on cloud servers, the present invention reduces the time delay of data transmission and processing, so that fault information can be perceived and responded to by users more quickly. The improvement of real-time performance is particularly important for emergency fault handling, and can effectively avoid safety hazards caused by information lag. By pre-creating and storing the model library, the vehicle system can quickly call the fault sub-model and display the faulty parts, avoiding the delay and computing burden caused by real-time modeling, ensuring the immediacy and accuracy of fault information, and improving the user experience. Especially for the limited resources in the vehicle system, the pre-created model library can optimize the storage and calling methods, reduce the memory usage and computing requirements at runtime, and help improve the overall performance and stability of the vehicle system, especially in the vehicle environment with limited resources.

[0044] In this embodiment, the reliance on the cloud server is removed or reduced, and the core functions of fault detection and display are transferred to the vehicle-side device. At the same time, limited connection with the cloud server is maintained only for auxiliary functions such as data backup and remote update. This architecture not only reduces the system's reliance on the network, but also improves the system's stability and reliability, and reduces the overall complexity and maintenance cost of the system.

[0045] For example, Figure 3As shown, the vehicle includes a body controller (IBCM), an engine controller (EMS), a transmission controller (TCU), an electronic stability controller (ESC), a power steering controller (EPS), an air conditioning controller (AC), a front camera controller (FCS), a corner radar controller (RSR), an onboard diagnostic system (OBD), a wireless receiver (RFR), an entertainment host (MDU), an airbag controller (ACU) and other controllers, and each controller can communicate with each other through a controller area network (CAN) bus. Optionally, the process of obtaining fault information by vehicle fault detection can be completed by the onboard diagnostic system, while the display of the three-dimensional model is completed by the entertainment host. The onboard diagnostic system transmits the fault information to the entertainment host, and the entertainment host generates and displays a three-dimensional framework model combined with the fault sub-model. Optionally, multiple controllers such as the body controller and the engine controller can be associated with the sub-models in the three-dimensional framework model respectively, and each controller can analyze the operation actions on the sub-model, so as to realize the control of each vehicle component through the corresponding controller.

[0046] In one embodiment, the fault information includes the fault type and the fault location. The model library is queried to obtain the target template fault model corresponding to the fault information, including: determining the vehicle component that has a fault in the vehicle based on the fault location; obtaining the fault level corresponding to the fault type; and the model library is queried to determine the component identifier of the vehicle component and the target template fault model corresponding to the fault level, wherein the display effect of the template fault model is different if the fault level of the same vehicle component in the model library is different.

[0047] In this embodiment, different fault levels are divided for various faults. When the fault levels of the same vehicle component are different, the display effect of the displayed fault sub-model is also different. In order to ensure that the display effects of different fault levels are different, different template fault models are configured for different fault levels when setting the model library in advance. Optionally, after receiving the fault information of a certain vehicle component, the target template fault model pre-created for the vehicle component can be directly corresponded according to the fault type and fault location, and the target template fault model can be displayed in different colors according to the fault level, such as red for serious warning, which means that the vehicle has a serious fault or is in a dangerous state and needs to stop driving immediately; yellow for reminder warning, which means that a certain function or vehicle component of the vehicle may have a problem, but it has not yet reached the level of serious fault; green for vehicle function status indication, such as a certain function is turned on or off. By matching the vehicle fault level with the template fault model through the pre-created sub-model and template fault model, the memory usage and computing requirements at runtime can be reduced, which helps to improve the overall performance and stability of the vehicle system and improve the efficiency of fault display.

[0048] In one embodiment, each template fault model in the model library includes corresponding fault troubleshooting information. Displaying the combined processed three-dimensional framework model includes: displaying the combined processed three-dimensional framework model and displaying the fault troubleshooting information.

[0049] In this embodiment, the troubleshooting information refers to the relevant information used for troubleshooting. The troubleshooting information can be pre-configured with the vehicle fault database. Each piece of troubleshooting information in the vehicle fault database corresponds to the template fault model one by one. That is to say, after determining the template fault model, the troubleshooting information can be quickly located from the vehicle fault database. Optionally, the troubleshooting information can be subdivided based on the fault level to generate detailed troubleshooting steps and solutions. Optionally, a learning algorithm can also be used to form a self-learning capability to learn a variety of troubleshooting information and faulty components, which can continuously optimize the algorithm model and improve the accuracy and efficiency of troubleshooting.

[0050] In this embodiment, the troubleshooting auxiliary function is implemented based on the troubleshooting information. Through the displayed fault sub-model and three-dimensional framework model, the user can confirm the vehicle fault, for example, verify the symptoms of the fault, analyze the possible causes of the fault, and determine the specific location of the fault. According to the fault type and fault level, the corresponding troubleshooting information is searched in the pre-established vehicle fault database, such as replacing the faulty parts, adjusting the parameters of the vehicle system, and performing software upgrades. The user can refer to the troubleshooting information to perform specific troubleshooting operations. Specifically, according to the classification of fault levels, for faults of lower levels, users can handle them according to the corresponding prompts; faults of higher levels may require professional maintenance personnel and corresponding tools and equipment. During the execution process, prompts to pay attention to safety matters and operating procedures. Based on the symptoms, causes, troubleshooting steps and solutions of various faults in the vehicle fault database, rich knowledge support is provided for the vehicle system. The vehicle fault database can be continuously updated and learned to ensure the comprehensiveness of the information in the vehicle fault database.

[0051] In this embodiment, after the troubleshooting process is completed, the faulty component needs to be verified to confirm whether the fault has been resolved. This can be verified by automatically retesting the relevant functions of the vehicle and observing whether the fault symptoms disappear. Specifically, after the troubleshooting process is completed, the system can automatically trigger the self-test module, or a manual trigger mechanism can be designed to allow the user to manually start the self-test when necessary. Test the key functions involved in the fault one by one to determine whether the faulty component can work normally after troubleshooting. For example, if the fault is an engine fault, the self-test module will test the engine's start, run and stop functions. After the key function test is passed, verify whether the parameters of each system of the vehicle have returned to the normal range, such as oil temperature, tire pressure, engine speed, etc. The self-test results are displayed to the user in an intuitive way such as a human-machine interface (HMI). If the self-test finds that there are still functions that have not returned to normal, provide clear feedback information to guide the user or maintenance personnel to further handle it. During the self-test process, safety restrictions should be set to avoid unnecessary damage to the vehicle or safety hazards. If a new fault or abnormal situation is found during the self-test process, the system should immediately issue a warning signal and take corresponding safety measures.

[0052] In this embodiment, based on the troubleshooting information, a reliable foundation is provided for self-service troubleshooting. Based on the display of the three-dimensional framework model combined with the fault sub-model, after detecting the vehicle fault, detailed and easy-to-understand self-service troubleshooting steps and guidance can be automatically provided to the user, so that the user can quickly locate and solve the fault without relying on professional technicians or conducting complex queries, which improves the practicality and efficiency of self-service troubleshooting and reduces the user's troubleshooting cost.

[0053] In this embodiment, by integrating advanced sensors and fault detection algorithms, the vehicle's operating status is monitored in real time, and when an abnormality is detected, fault identification and classification are automatically performed. Specifically, not only the fault type is identified, but also different levels of fault troubleshooting information can be intelligently provided to the user according to the fault level. For faults of various fault levels, the troubleshooting information includes preset detailed self-service troubleshooting steps. The self-service troubleshooting steps have been verified and optimized by professional technicians to ensure that users can solve the problem smoothly according to the correct instructions. The self-service troubleshooting steps are presented in a variety of forms such as text and picture combination and video demonstration, which are both intuitive and easy to understand, greatly reducing the user's operating difficulty and improving the success rate of fault resolution.

[0054] In this embodiment, a real-time online support function can also be provided to provide the contact information or professional repair address of professional maintenance personnel, so that users can ask the system or professional technicians for help at any time during the troubleshooting process to obtain more detailed guidance. An intelligent feedback mechanism can also be provided to dynamically adjust the troubleshooting steps and prompts according to the user's operation conditions to ensure that the user can successfully solve the problem.

[0055] In this embodiment, detailed troubleshooting information can be displayed on one side of the three-dimensional display interface, including the fault name, fault level, possible cause of the fault, troubleshooting suggestions and troubleshooting operation methods. These troubleshooting information are dynamically generated according to the actual situation of the fault model. The three-dimensional framework model combined with the fault sub-model and the troubleshooting information are displayed at the same time, which not only enables the user to fully understand the fault situation, but also provides the user with specific solutions. At the same time, according to the different fault levels, the system provides different troubleshooting information to ensure that the user can choose the appropriate solution according to the actual situation.

[0056] In this embodiment, based on big data analysis and machine learning technology, potential problems in vehicle operation can be identified and fault prediction can be performed. By notifying users in advance and suggesting preventive measures, it helps to avoid major faults, extend the service life of the vehicle, and reduce maintenance costs.

[0057] In one embodiment, the troubleshooting information includes animation data for indicating troubleshooting. Displaying the combined processed 3D framework model and the troubleshooting information includes: dynamically displaying the troubleshooting information based on the animation data when displaying the combined processed 3D framework model.

[0058] In this embodiment, based on the animation data of troubleshooting, the troubleshooting steps can be dynamically displayed, effectively guiding users to perform self-service operations, avoiding the abstractness of graphic descriptions, and greatly reducing the user's operating difficulty in the most intuitive and easy-to-understand way, thereby improving the success rate of troubleshooting.

[0059] In one embodiment, the fault display method further includes: obtaining update data of the template fault model, wherein the update data includes modification data, new data and / or deletion data of the template fault model; and updating the template fault model in the model library based on the update data.

[0060] In this embodiment, the template fault models in the template library can be flexibly configured. With the continuous advancement of technology and changes in user needs, the template fault models can be modified, created and / or deleted in a targeted manner, reducing maintenance costs and improving the compatibility and extensibility of three-dimensional display data. Since the template library is pre-created and stored, when vehicle parts change or fault types are updated, the corresponding template fault models can be updated, making the fault display function easier to expand and upgrade.

[0061] In one embodiment, displaying the combined processed three-dimensional framework model includes: displaying the combined processed three-dimensional framework model upon receiving a fault display instruction, wherein the fault display instruction includes a trigger instruction or a voice instruction instructing the fault display.

[0062] In this embodiment, after the fault sub-model is combined with the three-dimensional frame model of the vehicle's overall frame, a fault promotion box may pop up first, and then the user may independently choose whether to display the fault by triggering a physical button or a virtual button. If necessary, a trigger instruction is generated according to the button trigger information, and then based on the trigger instruction, the three-dimensional frame model combined with the fault sub-model is displayed. Alternatively, after the fault sub-model is combined with the three-dimensional frame model of the vehicle's overall frame, a fault voice prompt may be performed first, and then the user may independently choose whether to display the fault by voice. If necessary, the user issues a voice instruction for displaying the fault, and then based on the voice instruction, the three-dimensional frame model combined with the fault sub-model is displayed.

[0063] In one embodiment, when the data in each of the above links is transmitted, the user data is encrypted using data encryption technology to ensure the security of the data during transmission. At the same time, the minimum necessary principle is followed to collect and process only necessary data related to fault detection to reduce the risk of data leakage. In addition, some sensitive data is stored in the vehicle-side device through the local storage mechanism, which further enhances the security of the data. Compared with the method of uploading fault data to the cloud for processing, the local storage mechanism reduces the risk of data leakage, allowing users to use the fault detection service more confidently. At the same time, the local storage mechanism also enables users to perform fault detection and troubleshooting in an off-network environment. Furthermore, system access rights are strictly managed, and only authorized users can access sensitive data and system functions.

[0064] In a specific embodiment, Figure 4 As shown in the figure, the process of vehicle fault detection and three-dimensional fault display is as follows:

[0065] After the vehicle is started, it is detected in real time through a variety of sensors;

[0066] Collect vehicle status data;

[0067] Determine whether the vehicle has a fault based on the collected vehicle data and normal parameters of the vehicle under normal conditions;

[0068] If the vehicle has not broken down, repeat the vehicle inspection regularly;

[0069] If a vehicle breaks down, the fault location, fault type and fault level are determined based on the fault information combined with the information corresponding to various faults in the pre-diagnosis database; at the same time, the fault detection range is narrowed based on the fault information, and targeted detection is performed again;

[0070] Based on the fault information, the 3D framework model combined with the fault sub-model is displayed, and the fault troubleshooting information is obtained from the vehicle fault database and displayed;

[0071] Users can troubleshoot faults on their own based on the displayed troubleshooting information and the 3D framework model combined with the fault sub-models;

[0072] If the user fails to resolve the problem, he or she can contact maintenance personnel for professional troubleshooting.

[0073] In the present application, the fault information of the vehicle is obtained; based on the fault information, the fault sub-model of the faulty component in the vehicle is obtained; the fault sub-model is combined with the three-dimensional frame model of the overall frame of the vehicle, and the combined three-dimensional frame model is displayed, wherein the three-dimensional frame model includes sub-models corresponding to each component of the vehicle, and the display effects of the fault sub-model and the three-dimensional frame model are different. In the above process, the three-dimensional frame model of the vehicle includes sub-models corresponding to each vehicle component, and when a certain vehicle component of the vehicle fails, the fault sub-model corresponding to the faulty component is combined with the three-dimensional frame model, thereby realizing modular processing of vehicle fault display, which is more efficient than directly processing the three-dimensional model of the whole vehicle. At the same time, based on the modular display, the fault sub-model and the three-dimensional frame model have different display effects, and the user can more intuitively see the relationship between the faulty component and the whole vehicle, so that the user can more easily and quickly understand the fault condition of the vehicle, thereby improving the user experience.

[0074] Example Vehicles

[0075] Correspondingly, an embodiment of the present application also provides a vehicle, the vehicle including a display module; the display module is used to display the fault sub-model and the three-dimensional framework model obtained by the fault display method provided by any of the above embodiments.

[0076] The vehicle provided in this embodiment belongs to the same application concept as the fault display method provided in the above embodiment of this application, and can apply the fault display method provided in any of the above embodiments of this application, and has the corresponding functional modules and beneficial effects of the execution method. For technical details not fully described in this embodiment, please refer to the specific processing content of the fault display method provided in the above embodiment of this application, and will not be repeated here.

[0077] Exemplary Devices

[0078] Accordingly, the embodiment of the present application also provides a fault display device, such as Figure 5 As shown, the device may include:

[0079] A first acquisition module 501 is used to acquire fault information of a vehicle;

[0080] A second acquisition module 502 is used to acquire a fault sub-model of a faulty component in the vehicle based on the fault information;

[0081] The model processing module 503 is used to combine the fault sub-model into the three-dimensional frame model of the vehicle's overall frame and display the combined three-dimensional frame model, wherein the three-dimensional frame model includes sub-models corresponding to each vehicle component of the vehicle, and the display effects of the fault sub-model and the three-dimensional frame model are different.

[0082] In one embodiment, the second acquisition module 502 is used to query the model library to obtain the target template fault model corresponding to the fault information, wherein the model library includes at least one three-dimensional template fault model, and each template fault model corresponds to a vehicle component; and determine the target template fault model as a fault sub-model.

[0083] In one embodiment, the fault information includes the fault type and the fault location;

[0084] The second acquisition module 502 is used to determine the vehicle component that has failed in the vehicle based on the fault location; obtain the fault level corresponding to the fault type; query the model library to determine the component identification of the vehicle component and the target template fault model corresponding to the fault level, wherein the display effect of the template fault model is different if the fault level of the same vehicle component in the model library is different.

[0085] In one embodiment, each template fault model in the model library includes corresponding fault troubleshooting information;

[0086] The model processing module 503 is used to display the three-dimensional framework model after the combination processing and to display the troubleshooting information.

[0087] In one embodiment, the troubleshooting information includes animation data for indicating troubleshooting;

[0088] The model processing module 503 is used to dynamically display the troubleshooting information based on the animation data when displaying the three-dimensional framework model after the combination processing.

[0089] In one embodiment, the fault display device also includes an update module for obtaining update data of the template fault model, wherein the update data includes modification data, new data and / or deletion data of the template fault model; based on the update data, the template fault model in the model library is updated.

[0090] In one embodiment, the model processing module 503 is used to display the processed three-dimensional framework model when receiving a fault display instruction, wherein the fault display instruction includes a trigger instruction or a voice instruction instructing the fault display.

[0091] The fault display device provided in this embodiment belongs to the same application concept as the fault display method provided in the above embodiments of this application, and can execute the fault display method provided in any of the above embodiments of this application, and has the corresponding functional modules and beneficial effects of the execution method. For technical details not fully described in this embodiment, please refer to the specific processing content of the fault display method provided in the above embodiments of this application, and will not be repeated here.

[0092] Exemplary Electronic Devices

[0093] The present application also provides an electronic device, such as Figure 6 As shown, the electronic device includes: a memory 600 and a processor 601.

[0094] The memory 600 is connected to the processor 601 and is used to store programs.

[0095] The processor 601 is used to implement the fault display method in the above embodiment by running the program stored in the memory 600.

[0096] Specifically, the electronic device may further include: a communication interface 602 , an input device 603 , an output device 604 and a bus 605 .

[0097] The processor 601, the memory 600, the communication interface 602, the input device 603 and the output device 604 are connected to each other via a bus.

[0098] Bus 605 may include a pathway for transferring information between the various components of the computer system.

[0099] The processor 601 may be a general-purpose processor, such as a general-purpose central processing unit (CPU), a microprocessor, etc., or an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the scheme of the present invention. It may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0100] The processor 601 may include a main processor, and may also include a baseband chip, a modem, etc.

[0101] The memory 600 stores a program for executing the technical solution of the present invention, and may also store an operating system and other key services. Specifically, the program may include a program code, and the program code includes a computer operation instruction. More specifically, the memory 600 may include a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM), other types of dynamic storage devices that can store information and instructions, a disk storage, a flash, and the like.

[0102] The input device 603 may include a device for receiving data and information input by a user, such as a keyboard, a mouse, a camera, a scanner, a light pen, a voice input device, a touch screen, a pedometer, or a gravity sensor.

[0103] Output device 604 may include a device that allows information to be output to a user, such as a display screen, printer, speaker, etc.

[0104] The communication interface 602 may include any transceiver or the like to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Network (WLAN), etc.

[0105] The processor 601 executes the program stored in the memory 600 and calls other devices, which can be used to implement the various steps of the fault display method provided in the above embodiments of the present application.

[0106] Exemplary computer program products and storage media

[0107] In addition to the above-mentioned method and device, an embodiment of the present application may also be a computer program product, which includes computer program instructions, and when the computer program instructions are executed by a processor, the processor executes the steps in the fault display method described in the embodiment of the present application.

[0108] The computer program product may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the embodiments of the present application, including object-oriented programming languages, such as Java, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as an independent software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0109] In addition, an embodiment of the present application may also be a storage medium on which a computer program is stored, and the computer program is executed by a processor to execute the steps of the fault display method described in the embodiment of the present application.

[0110] For the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0111] It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0112] The steps in the methods of each embodiment of the present application can be adjusted in order, combined and deleted according to actual needs, and the technical features recorded in each embodiment can be replaced or combined.

[0113] The modules and sub-modules in the devices and terminals provided in the embodiments of the present application can be merged, divided and deleted according to actual needs.

[0114] In the several embodiments provided in the present application, it should be understood that the disclosed terminals, devices and methods can be implemented in other ways. For example, the terminal embodiments described above are only schematic, for example, the division of modules or submodules is only a logical function division, and there may be other division methods in actual implementation, for example, multiple submodules or modules can be combined or integrated into another module, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.

[0115] The modules or submodules described as separate components may or may not be physically separated, and the components of the modules or submodules may or may not be physical modules or submodules, that is, they may be located in one place, or they may be distributed on multiple network modules or submodules. Some or all of the modules or submodules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0116] In addition, each functional module or submodule in each embodiment of the present application may be integrated into one processing module, or each module or submodule may exist physically separately, or two or more modules or submodules may be integrated into one module. The above-mentioned integrated modules or submodules may be implemented in the form of hardware or in the form of software functional modules or submodules.

[0117] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0118] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly by hardware, software units executed by a processor, or a combination of the two. The software units may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0119] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0120] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A fault display method, characterized in that: include: Obtain vehicle fault information; Based on the fault information, obtaining a fault sub-model of the faulty component in the vehicle; The fault sub-model is combined with the three-dimensional frame model of the vehicle's overall frame, and the combined three-dimensional frame model is displayed, wherein the three-dimensional frame model includes sub-models corresponding to various vehicle components of the vehicle, and the display effects of the fault sub-model and the three-dimensional frame model are different.

2. The fault display method according to claim 1, characterized in that: The acquiring, based on the fault information, a fault sub-model of the faulty component in the vehicle comprises: Querying a model library to obtain a target template fault model corresponding to the fault information, wherein the model library includes at least one three-dimensional template fault model, and each template fault model corresponds to one of the vehicle components; The target template fault model is determined to be the fault sub-model.

3. The fault display method according to claim 2, characterized in that: The fault information includes the fault type and the fault location; The query model library is used to obtain the target template fault model corresponding to the fault information, including: Based on the fault location, determining the vehicle component in the vehicle that has failed; Obtaining a fault level corresponding to the fault type; The model library is queried to determine the target template fault model corresponding to the component identification of the vehicle component and the fault level, wherein the display effect of the template fault model is different if the fault level of the same vehicle component in the model library is different.

4. The fault display method according to claim 3, characterized in that: Each of the template fault models in the model library includes corresponding fault troubleshooting information; The display combined with the processed three-dimensional framework model includes: The three-dimensional framework model after combined processing is displayed, and the troubleshooting information is displayed.

5. The fault display method according to claim 4, characterized in that: The fault troubleshooting information includes animation data for indicating the troubleshooting; The displaying of the three-dimensional framework model after the combination processing and the displaying of the troubleshooting information include: When displaying the three-dimensional framework model after the combined processing, the troubleshooting information is dynamically displayed based on the animation data.

6. The fault display method according to claim 2, characterized in that: The method further comprises: Acquire update data of the template fault model, wherein the update data includes modification data, new data and / or deletion data of the template fault model; Based on the update data, the template fault model in the model library is updated.

7. The fault display method according to claim 1, characterized in that: The display combined with the processed three-dimensional framework model includes: When a fault display instruction is received, the three-dimensional framework model after the combined processing is displayed, wherein the fault display instruction includes a trigger instruction or a voice instruction instructing the fault display.

8. A vehicle, characterized in that: The vehicle includes a display module; The display module is used to display the fault sub-model and the three-dimensional framework model obtained by the fault display method described in any one of claims 1-7.

9. An electronic device, characterized in that: include: Memory and processor; The memory is connected to the processor and is used to store programs; The processor is used to implement the fault display method according to any one of claims 1 to 7 by running the program in the memory.

10. A computer program product, characterized in that includes computer program instructions; When the computer program instructions are executed by a processor, the processor is caused to execute the fault display method according to any one of claims 1 to 7.

Images