A digital mirror technology-based automobile comprehensive detection system and method

The comprehensive vehicle inspection system using digital mirror technology enables real-time data interaction and fault diagnosis, solving the problems of insufficient accuracy and safety in existing vehicle inspection technologies. In particular, it can quickly and accurately detect vehicle faults under sudden operating conditions.

CN116839927BActive Publication Date: 2026-06-23JILIN UNIVERSITY

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
JILIN UNIVERSITY
Filing Date
2023-05-31
Publication Date
2026-06-23

AI Technical Summary

Technical Problem

Existing vehicle inspection technologies cannot meet the demands of modern vehicle inspection for efficiency, accuracy, and safety, especially in the face of unexpected situations.

Method used

The vehicle comprehensive inspection system based on digital mirror technology achieves real-time data interaction and fault diagnosis through data mapping between physical space and digital mirror space, using digital model modules, fault diagnosis modules, etc., and combines convolutional neural networks for feature value extraction and alarm threshold judgment.

Benefits of technology

It enables rapid and accurate detection and prediction of vehicle faults, improving the reliability, practicality, and safety of detection, and is able to cope with unexpected working conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116839927B_ABST
    Figure CN116839927B_ABST
Patent Text Reader

Abstract

The application discloses a kind of based on digital mirror technology's automobile comprehensive detection system and method, pass through a variety of state sensors and collect automobile data, using digital mirror technology will the data of entity space be mapped to digital mirror space, can make automobile digital model with the real-time data of automobile entity interact, then based on the fault diagnosis module and digital model module of digital mirror space to the fault of automobile is intuitively effective diagnosis and prediction, can be quickly and accurately checked and predicted to the fault of automobile, realized to the comprehensive detection effect of automobile, with good reliability, practicality and safety, solved the shortcoming that present technical on-line detection technology research is less and cannot cope with sudden working condition.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention belongs to the field of automotive fault detection technology, specifically relating to a comprehensive automotive testing system and method based on digital mirror technology. Background Technology

[0002] With the development and popularization of the automotive industry, China has now entered the era of mass car consumption, and cars have greatly facilitated our lives. However, as a complex system, the comprehensive performance fault detection of automobiles is also a headache for people.

[0003] In the past, people mainly relied on experienced mechanics to discover car faults and make targeted repairs. With the development of computer technology, car fault detection technology has also entered the computer age. Traditional car detection methods can no longer meet the needs of modern car inspections that require continuous improvement and cannot cope with unexpected situations. Fully automated car detection technology will replace mechanics and semi-automated detection technologies.

[0004] With the development of other emerging technologies, the development of automotive testing equipment and methods will be further promoted. Digital mirroring is an emerging technology in recent years, characterized by real-time synchronization and high fidelity. It can establish a high-fidelity digital model of a physical entity, and utilize the information interaction and fusion between the digital model and the physical entity to enable the model to be updated and to accurately and in real-time respond to the physical entity. Therefore, this invention proposes a novel comprehensive automotive testing system based on digital mirroring technology, which can not only detect automotive faults online, but also has higher accuracy, reliability, and safety. Summary of the Invention

[0005] (a) Technical problems to be solved

[0006] To address the shortcomings of existing automotive inspection technologies, this invention aims to provide a comprehensive automotive inspection system and method based on digital mirroring technology. Through a digital mirroring platform, based on digital model modules, fault diagnosis modules, and physics engine modules, the digital model of the vehicle can interact with real-time data of the actual vehicle. This allows for rapid and accurate inspection and prediction of vehicle faults, achieving comprehensive vehicle inspection results. It offers excellent reliability, practicality, and safety, overcoming the limitations of existing methods that have limited research on online automotive inspection technology and are unable to handle unexpected operating conditions.

[0007] (II) Technical Solution

[0008] To achieve the above objectives, the present invention specifically adopts the following technical solution:

[0009] On the one hand, the present invention provides a comprehensive vehicle inspection system based on digital mirroring technology, including a physical physical space and a digital mirroring space. The physical physical space and the digital mirroring space are connected through a data transmission channel, and the data of the physical space is mapped to the digital mirroring space using digital mirroring technology to achieve real-time data sharing.

[0010] The physical space includes a central controller, a vehicle inspection platform, and data acquisition equipment. The vehicle inspection platform is used to support the vehicle, install the robotic arm, and provide a working environment. The data acquisition equipment is used to collect data from the vehicle and transmit the collected data in real time to the controller module in the digital mirror space via a data transmission channel. The central controller is used to control the vehicle inspection platform and the data acquisition equipment.

[0011] The digital mirror space includes a controller module, a digital model module, a physical drive engine module, and a fault diagnosis module. The controller module is used to preprocess the acquired data and extract feature values. The fault diagnosis module performs fault diagnosis and prediction on the preprocessed data based on the alarm threshold range of the feature vector, and transmits the obtained detection results to the main controller through the data transmission channel. The digital model module issues motion control commands to the vehicle entity on the computer, thereby realizing real-time interaction between the vehicle digital model and the vehicle entity data. The physical drive engine module is used to drive the data acquisition equipment.

[0012] Furthermore, the data acquisition equipment includes a surface scanning device, a robotic arm data acquisition device, a pressure data acquisition device, a control system data acquisition device, a brake pad data acquisition device, and a temperature data acquisition device. The surface scanning device is mounted on the robotic arm of the vehicle inspection platform and collects surface information of the vehicle as the robotic arm moves. The robotic arm data acquisition device collects motion status information of the robotic arm through sensors installed on the robotic arm. The pressure data acquisition device collects multiple pressure data of the vehicle through a pressure gauge set and a vehicle pressure sensor. The control system data acquisition device collects various data from the vehicle's electronic control system. The brake pad data acquisition device collects data on the wear condition of the vehicle's brake pads through a camera. The temperature data acquisition device collects various temperature data of the vehicle.

[0013] Furthermore, the digital model module includes a three-dimensional geometric model of the vehicle, a kinematics model of the vehicle, a kinematics model of the robotic arm, a dynamics model of the robotic arm, and a working environment model. The working environment model includes environmental geometric features and environmental attribute features.

[0014] On the other hand, the present invention also provides a comprehensive vehicle inspection method based on digital mirror technology, characterized by employing any of the above-mentioned systems and the following steps:

[0015] S1. A digital model of a car is established by importing the physical diagram and data information of the car. Then, simulation calculations are performed based on the digital model of the car. Feature vectors are extracted from the simulation data to establish a digital model database of normal cars. Based on the digital model database of normal cars, feature vector alarm threshold ranges are formed.

[0016] S2. Use data acquisition equipment to collect data from the vehicle entity and transmit the collected data to the digital mirror space;

[0017] S3. The collected data is entered into the controller module. First, the data is denoised. Then, the convolutional neural network in the controller module is used to extract the feature values ​​of the data. Then, the fault status diagnosis module is used to perform fault diagnosis and prediction on the data processed by the controller based on the feature vector alarm threshold range formed by the database of normal automobile digital models. If the alarm threshold range is exceeded, the fault is diagnosed.

[0018] S4. The obtained test results are transmitted to the main controller, which then displays the test results on the screen, completing a comprehensive test of the entire vehicle.

[0019] (III) Beneficial Effects

[0020] The beneficial effects of this invention are as follows:

[0021] The present invention relates to a comprehensive vehicle inspection system and method based on digital mirroring technology. This system collects vehicle data through multiple state sensors and uses digital mirroring technology to map data from the physical space onto a digital mirroring space. This allows the vehicle's digital model to interact with the real-time data of the vehicle's physical form. Then, based on the fault diagnosis module and digital model module within the digital mirroring space, the system performs intuitive and effective diagnosis and prediction of vehicle faults. This enables rapid and accurate inspection and prediction of vehicle faults, achieving comprehensive vehicle inspection. It exhibits excellent reliability, practicality, and safety, overcoming the shortcomings of existing technologies, such as limited research on online vehicle inspection technology and the inability to handle unexpected operating conditions. Attached Figure Description

[0022] To more clearly illustrate the structure and technical solution of this invention, the accompanying drawings used in this invention will be briefly introduced below.

[0023] Figure 1 This is a functional block diagram of the vehicle comprehensive inspection system based on digital mirror technology provided in this embodiment of the invention;

[0024] Figure 2 This is a flowchart of a comprehensive vehicle inspection method based on digital mirror technology provided in an embodiment of the present invention. Detailed Implementation

[0025] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0026] This invention provides a comprehensive vehicle inspection system based on digital mirror technology, such as... Figure 1 As shown, it includes a physical entity space and a digital mirror space. The physical entity space and the digital mirror space are connected through a data transmission channel, and digital mirroring technology is used to map the data of the physical space to the digital mirror space to achieve real-time data sharing.

[0027] The physical space includes a central controller, a vehicle inspection platform, and data acquisition equipment. The vehicle inspection platform is used to support the vehicle, install the robotic arm, and provide a working environment. The data acquisition equipment is used to collect vehicle data and transmit the collected data to the controller module of the digital mirror space in real time through a data transmission channel. The central controller is used to control the vehicle inspection platform and the data acquisition equipment.

[0028] Specifically, the data acquisition equipment includes surface scanning equipment, robotic arm data acquisition equipment, pressure data acquisition equipment, control system data acquisition equipment, brake pad data acquisition equipment, and temperature data acquisition equipment. The surface scanning equipment is mounted on the robotic arm of the vehicle inspection platform and collects surface information of the vehicle as the robotic arm moves. The robotic arm data acquisition equipment collects motion status information of the robotic arm through sensors installed on the robotic arm. The pressure data acquisition equipment collects multiple pressure data of the vehicle through a pressure gauge set and a vehicle pressure sensor. The control system data acquisition equipment collects various data from the vehicle's electronic control system. The brake pad data acquisition equipment collects data on the wear condition of the vehicle's brake pads through a camera. The temperature data acquisition equipment collects various temperature data of the vehicle.

[0029] The digital mirror space includes a controller module, a digital model module, a physical drive engine module, and a fault diagnosis module. The controller module is used to preprocess the acquired data and extract feature values. The fault diagnosis module performs fault diagnosis and prediction on the preprocessed data based on the alarm threshold range of the feature vector, and transmits the obtained detection results to the main controller through the data transmission channel. The digital model module issues motion control commands to the vehicle entity on the computer, thereby realizing real-time interaction between the vehicle digital model and the vehicle entity data. The physical drive engine module is used to drive the data acquisition equipment.

[0030] The digital mirror space uses a digital model module to map the physical space mechanism, enabling real-time data sharing and thus achieving the analysis and prediction of vehicle faults. Specifically, the digital model module includes a three-dimensional geometric model of the vehicle, a vehicle kinematics model, a robotic arm kinematics model, a robotic arm dynamics model, and a working environment model. The working environment model includes environmental geometric features and environmental attribute features.

[0031] The aforementioned comprehensive vehicle testing system is based on real-time shared monitoring data. Through the interaction between real-time vehicle data and the vehicle's digital model, it diagnoses and predicts vehicle faults in a digital mirror space.

[0032] The vehicle inspection system based on the aforementioned digital mirror technology is used for inspection, and the method is as follows: Figure 2 As shown, it includes the following steps:

[0033] S1. A digital model of a car is established by importing the physical diagram and data information of the car. Then, simulation calculations are performed based on the digital model of the car. Feature vectors are extracted from the simulation data to establish a digital model database of normal cars. Based on the digital model database of normal cars, feature vector alarm threshold ranges are formed.

[0034] S2. Use data acquisition equipment to collect data from the vehicle entity and transmit the collected data to the digital mirror space; the aforementioned data acquisition equipment includes a surface scanning device for collecting surface data, a robotic arm data acquisition device for collecting data from the robotic arm, a pressure data acquisition device for collecting various pressure data of the vehicle, a control system data acquisition device for collecting data from the vehicle's electronic system, a brake pad data acquisition device for collecting data on brake pad wear, and a temperature data acquisition device for collecting various temperature data of the vehicle.

[0035] S3. The collected data is entered into the controller module. First, the data is denoised. Then, the convolutional neural network in the controller module is used to extract the feature values ​​of the data. Then, the fault status diagnosis module is used to perform fault diagnosis and prediction on the data processed by the controller based on the feature vector alarm threshold range formed by the database of normal automobile digital models. If the alarm threshold range is exceeded, the fault is diagnosed.

[0036] S4. The obtained test results are transmitted to the main controller, which then displays the results on the screen, completing a comprehensive test of the entire vehicle. 。

[0037] The above are merely preferred embodiments of the present invention and are not intended to limit the present invention. The scope of patent protection of the present invention shall be determined by the claims. Similarly, any equivalent structural changes made based on the description and drawings of the present invention shall also be included within the scope of protection of the present invention.

Claims

1. A comprehensive vehicle inspection system based on digital mirroring technology, characterized in that, It includes a physical physical space and a digital mirror space. The physical physical space and the digital mirror space are connected through a data transmission channel, and digital mirroring technology is used to map the data of the physical space to the digital mirror space to achieve real-time data sharing. The physical space includes a central controller, a vehicle inspection platform, and data acquisition equipment. The vehicle inspection platform is used to support the vehicle, install the robotic arm, and provide a working environment. The data acquisition equipment is used to collect data from the vehicle and transmit the collected data in real time to the controller module in the digital mirror space via a data transmission channel. The central controller is used to control the vehicle inspection platform and the data acquisition equipment. The digital mirror space includes a controller module, a digital model module, a physical drive engine module, and a fault diagnosis module. The controller module is used to preprocess the acquired data and extract feature values. The fault diagnosis module performs fault diagnosis and prediction on the preprocessed data based on the alarm threshold range of the feature vector, and transmits the obtained detection results to the main controller through the data transmission channel. The digital model module issues motion control commands to the vehicle entity on the computer, thereby realizing real-time interaction between the vehicle digital model and the vehicle entity data. The physical drive engine module is used to drive the data acquisition equipment. The data acquisition equipment includes surface scanning equipment, robotic arm data acquisition equipment, pressure data acquisition equipment, control system data acquisition equipment, brake pad data acquisition equipment, and temperature data acquisition equipment. Specifically, the surface scanning equipment is mounted on the robotic arm of the vehicle inspection platform and collects surface information of the vehicle as the robotic arm moves. The robotic arm data acquisition equipment collects motion status information of the robotic arm through sensors installed on it. The pressure data acquisition equipment collects multiple pressure data of the vehicle through a pressure gauge set and vehicle pressure sensors. The control system data acquisition equipment collects various data from the vehicle's electronic control system. The brake pad data acquisition equipment collects data on the wear condition of the vehicle's brake pads through a camera. The temperature data acquisition equipment collects various temperature data of the vehicle. The digital model module includes a three-dimensional geometric model of the vehicle, a dynamics model of the vehicle, a dynamics model of the robotic arm, a power dynamics model of the robotic arm, and a working environment model. The working environment model includes environmental geometric features and environmental attribute features.

2. A comprehensive vehicle inspection method based on digital mirror technology, characterized in that, Using the system of claim 1 and the following steps: S1. A digital model of a car is established by importing the physical diagram and data information of the car. Then, simulation calculations are performed based on the digital model of the car. Feature vectors are extracted from the simulation data to establish a digital model database of normal cars. Based on the digital model database of normal cars, feature vector alarm threshold ranges are formed. S2. Use data acquisition equipment to collect data from the vehicle entity and transmit the collected data to the digital mirror space; S3. Input the collected data into the controller module, first process the data for noise reduction, then use the convolutional neural network in the controller module to extract the feature values ​​of the data, and then use the fault status diagnosis module to perform fault diagnosis and prediction on the data processed by the controller based on the feature vector alarm threshold range formed by the database of normal car digital models. If the alarm threshold range is exceeded, a fault will be diagnosed. S4. The obtained test results are transmitted to the main controller, which then displays the test results on the screen, completing a comprehensive test of the entire vehicle.