Automobile intelligent maintenance method and system based on AR glasses and OBD diagnosis module

Abstract

The invention relates to the technical field of automobile intelligent maintenance based on AR glasses and an OBD diagnosis module, in particular to an automobile intelligent maintenance method and system based on the AR glasses and the OBD diagnosis module, and the method comprises the following steps: 1, calling fault information; step 2, fault phenomenon confirmation; step 3, fault diagnosis; according to the method, links which need to look up data and manually judge in traditional maintenance are digitalized by adopting AR glasses in an interaction mode that what you see is what you get, the efficiency is improved (for example, the fault positioning time is shortened by 50%), the technical threshold is reduced, and the method is particularly suitable for maintenance scenes of complex electronic systems such as new energy automobiles.

Description

Technical Field

[0001] The present invention relates to the technical field of automobile intelligent maintenance based on AR glasses and an OBD diagnostic module, and in particular to an automobile intelligent maintenance method and system based on AR glasses and an OBD diagnostic module. Background Art

[0002] Traditional automotive fault detection relies on specialized tools and personnel, resulting in complex operations, opaque information, and limited widespread adoption. Augmented reality (AR) technology can overlay digital information onto the user's field of view, integrating information with reality. However, there are currently no mature solutions for integrating it with vehicle OBD diagnostic systems for maintenance guidance. Summary of the Invention

[0003] To solve the above technical problems, the present invention provides an automobile intelligent maintenance method and system based on AR glasses and OBD diagnostic module, which includes the following steps:

[0004] Step 1: Fault information retrieval: The maintenance personnel wear AR glasses and use OCR or code scanning technology to identify the vehicle VIN number. The AR glasses request vehicle fault information from the OBD diagnostic module and display it on the glasses display terminal;

[0005] Step 2: Fault phenomenon confirmation: AR glasses scan the code to bind to the OBD diagnostic device, realize remote control, retest and confirm the fault, and ensure the accuracy of the fault information;

[0006] Step 3: Fault Diagnosis: The AR glasses send the confirmed fault information to the vehicle maintenance system. The system performs intelligent analysis based on the fault history data and knowledge base, retrieves the cause of the problem and troubleshooting steps, and then feeds it back to the AR glasses for simultaneous display.

[0007] Step 4: Data viewing and remote support: During the troubleshooting process, maintenance personnel can use AR glasses to retrieve product information of related parts. If they encounter difficult problems, they can also access the enterprise communication platform to remotely contact relevant engineers and technical experts through audio and video, share on-site images, and obtain remote guidance.

[0008] The AR system architecture consists of OBD diagnostic module, AR glasses module, vehicle maintenance system and communication network.

[0009] Preferably, the OBD diagnostic module monitors the operating parameters of electronic control units such as the engine control unit and the transmission control unit in real time through the on-board diagnostic interface, collects vibration signals, temperature, pressure and other data of key components such as the engine and transmission system, and provides basic information for fault diagnosis.

[0010] Preferably, the AR glasses module, as a human-computer interaction terminal, has functions such as micro-projection, video recording, storage and transmission, and voice interaction. It can display fault information and repair steps, capture on-site footage and transmit it to remote experts. It can also be operated via voice or touch, allowing maintenance personnel to obtain information and perform operations hands-free.

[0011] Preferably, the vehicle maintenance system imports historical vehicle fault information, maintenance manuals, electrical schematics, and other technical documents to establish retrieval and association rules. After receiving the fault information sent by the AR glasses, it uses big data retrieval technology to analyze the fault, provide maintenance guidance, and push relevant information to the AR glasses.

[0012] Preferably, the communication network is responsible for connecting the modules and enabling data transmission and interaction. It supports wireless networks such as 4G / 5G, ensuring that data collected by the OBD diagnostic module can be quickly transmitted to the vehicle maintenance system, and that feedback from the maintenance system can be promptly transmitted to the AR glasses, while also ensuring smooth remote audio and video communication.

[0013] Preferably: the visualization display of fault information of the AR glasses module is specifically manifested in the real-time reading of fault codes: by scanning the OBD interface or entering the vehicle VIN number, the fault codes and data streams of the engine, gearbox and other systems are directly retrieved and displayed in the field of view in the form of floating text, without the need to manually consult the diagnostic instrument, and the fault location can be marked: according to the OBD diagnosis results, the faulty parts (such as sensors, line connectors) are marked with highlighted colors or arrows in the AR screen, which intuitively prompts the maintenance personnel to the specific location and reduces the troubleshooting time.

[0014] The AR glasses module preferably includes a built-in dynamic repair manual: paper repair manuals are converted into 3D animations or step-by-step instructions, displaying the disassembly and installation process in real time on the AR glasses. For example, when replacing brake pads, the glasses will display details such as the screw removal sequence and torque requirements. Parts information can also be queried: when looking at a specific part, the AR glasses can automatically retrieve its model, specifications, compatible vehicle model, and other information, avoiding errors caused by confusing parts models.

[0015] Preferably: the AR system can realize real-time audio and video connection: when maintenance personnel encounter difficult faults, they can use AR glasses to shoot the scene, and remote experts can mark the problem points in real time (such as "the line here is broken") and provide voice guidance for operation, which is similar to "first-person perspective" collaboration.

[0016] Preferably, the AR glasses module is specifically manifested as AR glasses, which integrate a micro-projection, a camera, a microphone, and an inertial sensor, and support high-definition picture display, environmental recognition (such as recognition of the position of engine compartment components), and voice / gesture control.

[0017] The technical effects and advantages of the present invention are as follows:

[0018] 1. The present invention uses AR glasses through a "what you see is what you get" interactive mode to digitize the links that require reference to data and manual judgment in traditional maintenance. It not only improves efficiency (such as shortening fault location time by 50%), but also lowers the technical threshold. It is particularly suitable for maintenance scenarios of complex electronic systems such as new energy vehicles.

[0019] 2. The system of the present invention combines "data-driven" with "visual interaction" through the deep integration of AR and OBD, which not only solves the pain points of "data abstraction and operation dependence on experience" in traditional maintenance, but also provides a technical carrier for intelligent and standardized maintenance. It is especially suitable for the complex system maintenance of new energy vehicles and high-end models. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is a first flow chart of an automobile intelligent maintenance method and system based on AR glasses and an OBD diagnostic module provided by the present invention;

[0021] Figure 2 This is a second flow chart of an automobile intelligent maintenance method and system based on AR glasses and an OBD diagnostic module provided by the present invention; DETAILED DESCRIPTION

[0022] The present invention will be described in further detail below with reference to the accompanying drawings and specific embodiments. The embodiments of the present invention are provided for purposes of illustration and description and are not intended to be exhaustive or to limit the invention to the disclosed forms. Many modifications and variations will be apparent to those skilled in the art. The embodiments are chosen and described to better illustrate the principles of the invention and its practical application, and to enable those skilled in the art to understand the invention and design various embodiments with various modifications suitable for specific applications.

[0023] See also Figures 1-2 The present invention provides an automobile intelligent maintenance method and system based on AR glasses and OBD diagnostic module, which includes the following steps:

[0024] Step 1: Fault information retrieval: The maintenance personnel wear AR glasses and use OCR or code scanning technology to identify the vehicle VIN number. The AR glasses request vehicle fault information from the OBD diagnostic module and display it on the glasses display terminal;

[0025] Step 2: Fault phenomenon confirmation: AR glasses scan the code to bind to the OBD diagnostic device, realize remote control, retest and confirm the fault, and ensure the accuracy of the fault information;

[0026] Step 3: Fault Diagnosis: The AR glasses send the confirmed fault information to the vehicle maintenance system. The system performs intelligent analysis based on the fault history data and knowledge base, retrieves the cause of the problem and troubleshooting steps, and then feeds it back to the AR glasses for simultaneous display.

[0027] Step 4: Data viewing and remote support: During the troubleshooting process, maintenance personnel can use AR glasses to retrieve product information of related parts. If they encounter difficult problems, they can also access the enterprise communication platform to remotely contact relevant engineers and technical experts through audio and video, share on-site images, and obtain remote guidance.

[0028] The AR system architecture consists of OBD diagnostic module, AR glasses module, vehicle maintenance system and communication network.

[0029] The OBD diagnostic module monitors the operating parameters of electronic control units such as the engine control unit and transmission control unit in real time through the on-board diagnostic interface, collects vibration signals, temperature, pressure and other data of key components such as the engine and transmission system, and provides basic information for fault diagnosis.

[0030] The AR glasses module, serving as a human-machine interaction terminal, features micro-projection, video recording, storage and transmission, and voice interaction. It can display fault information and repair procedures, capture on-site footage, and transmit it to remote experts. It can also be operated via voice or touch, allowing maintenance personnel to access information and perform operations hands-free.

[0031] The car maintenance system imports historical vehicle fault information, repair manuals, electrical schematics, and other technical documents to establish retrieval and association rules. After receiving fault information sent by AR glasses, it uses big data retrieval technology to analyze the fault, provide repair guidance, and push relevant information to the AR glasses.

[0032] The communication network is responsible for connecting the various modules and enabling data transmission and interaction. It supports wireless networks such as 4G / 5G, ensuring that data collected by the OBD diagnostic module can be quickly transmitted to the vehicle maintenance system, and that feedback from the maintenance system can be promptly transmitted to the AR glasses, while also ensuring smooth remote audio and video communication.

[0033] The AR glasses module's visualization of fault information is specifically manifested in real-time reading of fault codes: by scanning the OBD interface or entering the vehicle's VIN number, the fault codes and data streams of the engine, transmission and other systems are directly retrieved and displayed in the field of view in the form of floating text, without the need to manually consult the diagnostic instrument. The fault location can also be marked: Based on the OBD diagnosis results, the faulty parts (such as sensors and line connectors) are marked with highlighted colors or arrows on the AR screen, intuitively prompting maintenance personnel with the specific location and reducing troubleshooting time.

[0034] The AR glasses module includes a built-in dynamic repair manual: paper repair manuals are converted into 3D animations or step-by-step instructions, displaying the disassembly and installation process in real time on the AR glasses. For example, when replacing brake pads, the glasses will display details such as the screw removal sequence and torque requirements. Parts information can also be queried: when looking at a specific part, the AR glasses will automatically retrieve its model, specifications, compatible vehicle model, and other information, avoiding errors caused by confusing parts models.

[0035] The AR system can achieve real-time audio and video connection: when maintenance personnel encounter difficult faults, they can use AR glasses to shoot the on-site images. Remote experts can mark the problem points in real time (such as "the line here is broken") and provide voice guidance for operations, similar to "first-person perspective" collaboration.

[0036] The AR glasses module is specifically manifested as AR glasses, which integrate a micro-projector, a camera, a microphone, and an inertial sensor, and support high-definition image display, environmental recognition (such as identifying the position of engine compartment components), and voice / gesture control.

[0037] Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field and related fields without making creative efforts should fall within the scope of protection of the present invention. Structures, devices, and operating methods not specifically described and explained in the present invention shall be implemented in accordance with conventional means in the field unless otherwise specified or limited.

Claims

1. A car intelligent maintenance method and system based on AR glasses and OBD diagnostic module, characterized in that: The following steps are included: Step 1: Fault information retrieval: The maintenance personnel wear AR glasses and use OCR or code scanning technology to identify the vehicle VIN number. The AR glasses request vehicle fault information from the OBD diagnostic module and display it on the glasses display terminal; Step 2: Fault phenomenon confirmation: AR glasses scan the code to bind to the OBD diagnostic device, realize remote control, retest and confirm the fault, and ensure the accuracy of the fault information; Step 3: Fault Diagnosis: The AR glasses send the confirmed fault information to the vehicle maintenance system. The system performs intelligent analysis based on the fault history data and knowledge base, retrieves the cause of the problem and troubleshooting steps, and then feeds it back to the AR glasses for simultaneous display. Step 4: Data viewing and remote support: During the troubleshooting process, maintenance personnel can use AR glasses to retrieve product information of related parts. If they encounter difficult problems, they can also access the enterprise communication platform to remotely contact relevant engineers and technical experts through audio and video, share on-site images, and obtain remote guidance. The AR system architecture consists of OBD diagnostic module, AR glasses module, vehicle maintenance system and communication network.

2. The method and system for intelligent automobile maintenance based on AR glasses and OBD diagnostic module according to claim 1, characterized in that ,The OBD diagnostic module monitors the operating parameters of the ,electronic control units such as the engine control unit and the transmission ,control unit in real time through the on-board diagnostic interface, ,and collects vibration signals, temperature, pressure and other data of key ,components such as the engine and transmission system, providing basic ,information for fault diagnosis.

3. The automobile intelligent maintenance method and system based on AR glasses and OBD diagnostic module according to claim 1 is characterized in that: The AR glasses module, serving as a human-machine interaction terminal, features micro-projection, video recording, storage and transmission, and voice interaction. It can display fault information and repair procedures, capture on-site footage, and transmit it to remote experts. It can also be operated via voice or touch, allowing maintenance personnel to access information and perform operations hands-free.

4. The method and system for intelligent automobile maintenance based on AR glasses and OBD diagnostic module according to claim 1, characterized in that: The car maintenance system imports historical vehicle fault information, repair manuals, electrical schematics, and other technical documents to establish retrieval and association rules. After receiving fault information sent by AR glasses, it uses big data retrieval technology to analyze the fault, provide repair guidance, and push relevant information to the AR glasses.

5. The method and system for intelligent automobile maintenance based on AR glasses and OBD diagnostic module according to claim 4, characterized in that: The communication network is responsible for connecting the various modules and enabling data transmission and interaction. It supports wireless networks such as 4G / 5G, ensuring that data collected by the OBD diagnostic module can be quickly transmitted to the vehicle maintenance system, and that feedback from the maintenance system can be promptly transmitted to the AR glasses, while also ensuring smooth remote audio and video communication.

6. The automobile intelligent maintenance method and system based on AR glasses and OBD diagnostic module according to claim 1, characterized in that: The AR glasses module's visualization of fault information is specifically manifested in real-time reading of fault codes: by scanning the OBD interface or entering the vehicle's VIN number, the fault codes and data streams of the engine, transmission and other systems are directly retrieved and displayed in the field of view in the form of floating text, without the need to manually consult the diagnostic instrument. The fault location can also be marked: Based on the OBD diagnosis results, the faulty parts (such as sensors and line connectors) are marked with highlighted colors or arrows on the AR screen, intuitively prompting maintenance personnel with the specific location and reducing troubleshooting time.

7. The automobile intelligent maintenance method and system based on AR glasses and OBD diagnostic module according to claim 1, characterized in that: The AR glasses module includes a built-in dynamic repair manual: paper repair manuals are converted into 3D animations or step-by-step instructions, displaying the disassembly and installation process in real time on the AR glasses. For example, when replacing brake pads, the glasses will display details such as the screw removal sequence and torque requirements. Parts information can also be queried: when looking at a specific part, the AR glasses will automatically retrieve its model, specifications, compatible vehicle model, and other information, avoiding errors caused by confusing parts models.

8. The method and system for intelligent automobile maintenance based on AR glasses and OBD diagnostic module according to claim 1, characterized in that: The AR system can achieve real-time audio and video connection: when maintenance personnel encounter difficult faults, they can use AR glasses to shoot the on-site images. Remote experts can mark the problem points in real time (such as "the line here is broken") and provide voice guidance for operations, similar to "first-person perspective" collaboration.

9. The method and system for intelligent automobile maintenance based on AR glasses and OBD diagnostic module according to claim 1, characterized in that: The AR glasses module is specifically manifested as AR glasses, which integrate a micro-projector, a camera, a microphone, and an inertial sensor, and support high-definition image display, environmental recognition (such as identifying the position of engine compartment components), and voice / gesture control.

Images