Automobile hub production line real-time monitoring system based on digital twinning
Through digital twin technology, the real-time monitoring system for automobile wheel hub production lines is solved, and the problem of untimely information interaction in traditional monitoring systems is realized, the accurate identification of equipment failures and intelligent management of production lines are achieved, and the production efficiency and product quality are improved.
Patent Information
- Application Number
- CN202411066233.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-05
- Publication Date
- 2024-11-26
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The information interaction of traditional automobile wheel hub production line monitoring systems is not timely, and production line equipment failures cannot be accurately and promptly discovered, which seriously restricts the development of intelligence.
Using a real-time monitoring system for automotive wheel hub production lines based on digital twins, the digital twin system builds modules, real-time data acquisition and transmission modules, monitoring modules and simulation optimization modules, to build a digital twin model, collects equipment data and product surface images in real time, and based on fault prediction. The model performs feature extraction and fault identification to achieve accurate and timely identification of equipment faults.
It realizes efficient and real-time visual monitoring of the automobile wheel hub production line, fast and accurate fault prediction, improves production efficiency and product quality, and promotes intelligent development.
Smart Images

Figure CN119024778A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of automobile intelligent manufacturing, and in particular to a real-time monitoring system for an automobile wheel hub production line based on digital twins. Background Art
[0002] With the popularization of automobiles, the demand for wheels is huge. At the same time, with the intensified competition among wheel manufacturers and the rapid iteration of products, wheel production is shifting towards personalized, diversified and complex methods. Automobile wheel manufacturing faces pressures such as shorter product delivery time, higher reliability requirements, and more frequent changes in product varieties. Therefore, the workshop management needs to understand the on-site operation of the production line in a timely manner and detect abnormal situations in production in a timely manner, so as to reasonably adjust the production plan and resource allocation, and improve the efficiency and reliability of wheel production. The traditional automobile wheel production and processing process is often monitored by setting up surveillance cameras or on-site monitoring.
[0003] However, the information exchange in the traditional automobile wheel hub production process is not timely and comprehensive, and the cost of on-site status monitoring is high, which leads to the failure of equipment in the production line to be discovered in time during monitoring. In addition, after the abnormal data of the equipment is found, it is usually analyzed manually, and the accuracy of the fault analysis results needs to be improved, which seriously restricts the development of intelligent automobile wheel hub production lines. Summary of the invention
[0004] The present invention provides a real-time monitoring system for an automobile wheel hub production line based on digital twins, which is used to solve the defect in the prior art that faults in equipment in the production line cannot be discovered in a timely and accurate manner when monitoring the automobile wheel hub production line.
[0005] The present invention provides a real-time monitoring system for an automobile wheel hub production line based on digital twins, comprising: Digital twin system building module, real-time data acquisition and transmission module, monitoring module and simulation optimization module; The digital twin system construction module is used to analyze the geometric properties and physical properties of each production unit of the automobile wheel hub production line to obtain a digital twin model to construct a digital twin system; The real-time data acquisition and transmission module is used to acquire the physical data of the automobile wheel hub production line in real time and transmit the physical data to a data storage unit; the physical data includes production line equipment data and product surface images; The monitoring module is used to extract features from the entity data based on the fault prediction model to obtain fault features, identify faults based on the fault features, obtain fault identification results, and display based on the fault identification results and the entity data; the fault prediction model is obtained by training based on sample entity data and an initial fault prediction model based on a neural network; The simulation optimization module is used to jointly debug the real-time monitoring system of the automobile wheel hub production line based on the simulation data of the digital twin system and the entity data, and to iteratively optimize the real-time monitoring system of the automobile wheel hub production line based on the joint debugging results.
[0006] According to a real-time monitoring system for an automobile wheel hub production line based on digital twin provided by the present invention, the monitoring module includes a fault prediction unit, and the fault prediction unit is specifically used for: Acquiring abnormal equipment data from the production line equipment data, and performing image detection on the product surface image to obtain a detection positioning image; Extracting features from the abnormal equipment data and the detection positioning image based on the fault prediction model to obtain the fault features, and performing fault identification based on the fault features to obtain a fault identification result; The fault characteristics include equipment fault characteristics and product defect characteristics.
[0007] According to a real-time monitoring system for an automobile wheel hub production line based on digital twins provided by the present invention, the real-time data acquisition and transmission module includes a real-time data acquisition unit and a transmission unit; The real-time data acquisition unit is used to acquire the production line equipment data and the original product surface image in real time, and perform edge computing on the original product surface image to obtain the product surface image; The transmission unit is used to compress the production line equipment data and the product surface image in sections to obtain compressed data, so as to transmit the compressed data to the data storage unit.
[0008] According to a real-time monitoring system for an automobile wheel hub production line based on digital twin provided by the present invention, the transmission unit is also specifically used for: Acquire a network bandwidth of a data transmission network, and when the network bandwidth is lower than a preset threshold, transmit the compressed data to the data storage unit based on a data transmission priority; The data transmission priority is determined based on the process difficulty of each production unit of the automobile wheel hub production line.
[0009] According to a real-time monitoring system for an automobile wheel hub production line based on digital twin provided by the present invention, the real-time data acquisition unit is specifically used for: Connecting multiple source sensors in various production units of the automobile wheel hub production line based on industrial Ethernet to form a communication channel; Based on the software built-in protocol driver, the data address of each device in the automobile wheel hub production line is obtained in an addressing manner on the communication channel to collect the production line equipment data and the original product surface image in real time.
[0010] According to a real-time monitoring system for an automobile wheel hub production line based on digital twin provided by the present invention, the digital twin system building module is specifically used for: Analyze the geometric and physical properties of each production unit of the automobile wheel production line and build a digital twin model; The digital twin model is laid out and constructed based on the physical layout of the automobile wheel hub production line, and the digital twin model is remodeled to construct the digital twin system; The secondary modeling includes establishing the behavior attributes, logic attributes, communication interfaces and driver connection scripts of each device under each production unit.
[0011] The present invention also provides a real-time monitoring method for an automobile wheel hub production line based on digital twins, comprising: Analyze the geometric and physical properties of each production unit of the automobile wheel production line to obtain a digital twin model and build a digital twin system; Collecting the physical data of the automobile wheel hub production line in real time, and transmitting the physical data to a data storage unit; the physical data includes production line equipment data and product surface images; Extracting features from the entity data based on the fault prediction model to obtain fault features, identifying faults based on the fault features to obtain fault identification results, and displaying the fault identification results and the entity data; the fault prediction model is obtained by training based on sample entity data and an initial fault prediction model based on a neural network; Based on the simulation data of the digital twin system and the entity data, the real-time monitoring system for an automobile wheel hub production line as described in any one of the above items is jointly debugged, and based on the joint debugging result, the real-time monitoring system for an automobile wheel hub production line is iteratively optimized.
[0012] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the real-time monitoring method for an automobile wheel hub production line based on digital twins as described above is implemented.
[0013] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the real-time monitoring method of an automobile wheel hub production line based on digital twins as described above is implemented.
[0014] The present invention also provides a computer program product, including a computer program, which, when executed by a processor, implements the real-time monitoring method for an automobile wheel hub production line based on digital twins as described above.
[0015] The real-time monitoring system for automobile wheel hub production line based on digital twin provided by the present invention enhances data interaction by constructing a digital twin system corresponding to the automobile wheel hub production line. On this basis, feature extraction is performed on production line equipment data and product surface images based on the fault prediction model to perform fault identification, thereby achieving accurate and timely fault prediction, as well as efficient and real-time visual monitoring of the automobile wheel hub production line. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0017] Figure 1 It is one of the structural schematic diagrams of the real-time monitoring system of the automobile wheel hub production line based on digital twin provided by the present invention; Figure 2 It is a data perception and interaction schematic diagram of the real-time monitoring system of the automobile wheel hub production line provided by the present invention; Figure 3 This is the second structural schematic diagram of the real-time monitoring system for automobile wheel hub production line based on digital twin provided by the present invention; Figure 4 It is an operation flow chart of the real-time monitoring system of the automobile wheel hub production line based on digital twin provided by the present invention; Figure 5 It is a work flow chart of the automobile wheel hub production line provided by the present invention; Figure 6 It is a control logic diagram of the automobile wheel hub production line provided by the present invention; Figure 7 It is a flow chart of a real-time monitoring method of an automobile wheel hub production line based on digital twin provided by the present invention; Figure 8 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION
[0018] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0019] In response to the above problems, the present invention provides a real-time monitoring system for an automobile wheel hub production line based on digital twins, which breaks the barriers to the interaction between the physical space and information space of traditional production lines, so as to achieve fast and accurate fault prediction of the wheel hub production line, and further realize real-time monitoring of the automobile wheel hub production line. Figure 1 This is one of the structural schematic diagrams of the real-time monitoring system for automobile wheel hub production line based on digital twin provided by the present invention, such as Figure 1 As shown, the system includes: a digital twin system construction module 110, a real-time data acquisition and transmission module 120, a monitoring module 130 and a simulation optimization module 140; The digital twin system construction module 110 is used to analyze the geometric properties and physical properties of each production unit of the automobile wheel hub production line to obtain a digital twin model to construct a digital twin system; The real-time data acquisition and transmission module 120 is used to acquire the physical data of the automobile wheel hub production line in real time and transmit the physical data to a data storage unit; the physical data includes production line equipment data and product surface images; The monitoring module 130 is used to extract features from the entity data based on the fault prediction model to obtain fault features, identify faults based on the fault features, obtain fault identification results, and display based on the fault identification results and the entity data; the fault prediction model is obtained by training based on sample entity data and an initial fault prediction model based on a neural network; The simulation optimization module 140 is used to jointly debug the real-time monitoring system of the automobile wheel hub production line based on the simulation data of the digital twin system and the entity data, and iteratively optimize the real-time monitoring system of the automobile wheel hub production line based on the joint debugging results.
[0020] Specifically, the digital twin system construction module 110 is used to analyze the geometric and physical properties of each production unit of the automobile wheel hub production line to obtain a digital twin model. Each production unit here includes: execution unit, tool unit, processing unit, detection unit, sorting unit, storage unit, master control unit, production line environment, etc. Each production unit contains corresponding production line equipment.
[0021] In addition, in the process of modeling the digital twin system, the geometric property analysis of each production unit can be performed by analyzing the shape, size, positional relationship and assembly relationship of the equipment under each production unit in the 3D modeling software to achieve accurate and high-fidelity digital 3D modeling. The physical property analysis of each production unit can be performed by analyzing the specific materials, quality, rigidity, strength, speed, acceleration, etc. of the equipment under each production unit to define and render, making the digital twin model more realistic, and saving it in a format file that can be recognized by the digital twin software, such as STL (StereoLithography) format. The 3D modeling software here can be CATIA (Computer Aided Three-dimensional Interactive Application), SolidWorks, UG (Unigraphics) and other modeling software.
[0022] After the digital twin model is constructed, the digital twin models of each unit can be laid out and built based on the automobile wheel hub production line to obtain a digital twin system corresponding to the actual automobile wheel hub production line.
[0023] In the real-time data acquisition and transmission module 120, first, corresponding sensors are set on the equipment under each production unit in the automobile wheel hub production line. Then, the physical data of the wheel hub production line is obtained by real-time acquisition of the data obtained by each multi-source sensor. For example, it can be through Simens TCP / IP driver, Modbus TCP / IP driver, ProfiNet driver, OPCUA driver data acquisition software, such as IOServer, and embedded OPC UA server data acquisition module developed using embedded data acquisition card, to sense and obtain the real-time data of each device at the bottom of each production unit in the physical production line in real time to obtain physical data. Finally, the physical data is transmitted to a storage unit, such as a SQL database. The physical data here includes but is not limited to key parameters such as temperature, pressure, vibration, current, voltage, and product surface images.
[0024] It should be noted that the entity data collected and transmitted here includes production line equipment data and product surface images. The production line equipment data here refers to the equipment parameters and operation data of each device in the production line. The product surface data here refers to the images collected from the products produced at each production node on the production line, which can be collected by visual inspection cameras.
[0025] In the monitoring module 130, feature extraction is performed on the entity data based on the fault prediction model to extract fault features. The fault prediction model here can be obtained by pre-training an initial fault prediction model based on a neural network based on sample entity data. Here, the initial fault prediction model can be constructed based on a deep convolutional neural network. In detail, multi-layer convolution can be performed on the entity data through the feature extraction layer in the fault prediction model to extract fault features. The fault features here can reflect the key abnormal data in the production line equipment data and the product surface image. Then, the fault identification is performed based on the fault features through the fault identification layer in the fault prediction model to obtain a fault identification result. The fault identification result here can be a failure of a certain equipment in the production line. Finally, the fault identification result and the entity data are displayed on the display device.
[0026] It should be noted that when a device fails, it will not only affect the production line equipment data of the corresponding equipment, that is, abnormal equipment data will appear, but also may cause abnormalities in the product surface image. Therefore, not only can the cause of the failure of the automobile wheel production line be analyzed from the production line equipment data, but the product surface image can also provide an analysis basis for fault analysis, making the fault identification results obtained by analysis more accurate. In addition, compared with manual fault identification, the fault identification based on the machine learning fault prediction model has greatly improved its recognition speed and accuracy. In the actual production system, it helps to actively push equipment maintenance alarm information, which is convenient for on-site managers to respond in advance and maintain the equipment, which helps to prevent production stoppages due to equipment failures, thereby improving the production quality and efficiency of the automobile wheel production line and promoting the development of intelligent automobile wheels.
[0027] The simulation optimization module 140 is used to jointly debug the real-time monitoring system of the automobile wheel hub production line based on the simulation data and entity data of the digital twin system, and iteratively optimize the real-time monitoring system of the automobile wheel hub production line based on the joint debugging results. For example, the digital twin system construction module, real-time data acquisition and transmission module, monitoring module, simulation optimization module, virtual and real variable binding module, production data visualization module, data storage module, data processing module, production line service system module, etc. in the real-time monitoring system of the automobile wheel hub production line can be optimized.
[0028] Among them, the production data visualization module uses digital twin simulation software as the display end for production data visualization, and displays the production, processing and transportation control actions of the real-time data-driven digital twin production line, dynamic information of the production process, operating status information of each production unit equipment, utilization rate, process parameters, product quantity, product qualification rate, logistics process, inventory status and other information in real time and dynamically in the form of tables, pie charts and other visual methods.
[0029] In addition, the data processing module is used to process the data after calling the historical data in the database and the real-time data collected by the data acquisition module, transfer the relevant data of the physical production line and the digital twin production line to the Excel software, and analyze, calculate and process the data, so as to realize the simulation, monitoring, evaluation, optimization, prediction, decision-making and other functions of the entire process, all elements and the entire process of the production line.
[0030] The production line service system modules include ERP (Enterprise Resource Planning), MES (Manufacturing Execution System), PDM (Product Data Management), WMS (Warehouse Management System), etc. By analyzing, storing and optimizing the data obtained from the physical production line and digital twin production line through the ERP, MES, PDM and WMS systems, it can realize the integrated analysis of production line data, production scheduling, real-time decision-making, inventory management and optimization and other functions.
[0031] The real-time monitoring system for automobile wheel hub production lines based on digital twins provided by the embodiment of the present invention enhances data interaction by constructing a digital twin system corresponding to the automobile wheel hub production line. On this basis, feature extraction is performed on production line equipment data and product surface images based on the fault prediction model to perform fault identification, thereby achieving accurate and timely fault prediction and efficient, real-time visual monitoring of the automobile wheel hub production line.
[0032] Based on any of the above embodiments, the monitoring module includes a fault prediction unit, and the fault prediction unit is specifically used to: Acquiring abnormal equipment data from the production line equipment data, and performing image detection on the product surface image to obtain a detection positioning image; Extracting features from the abnormal equipment data and the detection positioning image based on the fault prediction model to obtain the fault features, and performing fault identification based on the fault features to obtain a fault identification result; The fault characteristics include equipment fault characteristics and product defect characteristics.
[0033] Specifically, first, after obtaining the production line equipment data, the production line equipment data can be processed, such as denoising, normalization and other pre-processing, and then the production line equipment data can be judged based on a pre-set reasonable data threshold, and then abnormal equipment data can be obtained. In addition, image detection can be performed on the product surface image to accurately locate the product area in the product surface image, that is, to obtain a detection positioning image.
[0034] It should be noted that data screening of production line equipment data to obtain abnormal equipment data and image detection of product surface images to obtain detection positioning images can effectively eliminate invalid data from the data used for fault prediction and avoid affecting the accuracy of fault prediction. At the same time, it greatly reduces the amount of data and improves the prediction speed of fault prediction.
[0035] Next, the abnormal equipment data and the detection positioning image are input into the fault prediction model, and the feature extraction network in the fault prediction model is used to extract the abnormal equipment data and the detection positioning image respectively, so as to extract the equipment fault features and the product defect features, i.e., the fault features. Then, the fault recognition network in the fault prediction model can be used to perform fault recognition based on the fault features, and the fault prediction can be performed by combining the equipment fault features and the product defect features to obtain the fault recognition result.
[0036] The method provided by the embodiment of the present invention greatly reduces the amount of data for fault identification by screening the acquired production line equipment data and product surface images, thereby improving the accuracy and speed of fault identification. It is understandable that in an actual automobile wheel hub production line, fast and accurate fault identification can greatly improve the production efficiency and production quality of the production line, realize automated fault prediction, and then realize automated monitoring to promote the intelligent development of automobile production lines.
[0037] Based on any of the above embodiments, the real-time data acquisition and transmission module includes a real-time data acquisition unit and a transmission unit; The real-time data acquisition unit is used to acquire the production line equipment data and the original product surface image in real time, and perform edge computing on the original product surface image to obtain the product surface image; The transmission unit is used to compress the production line equipment data and the product surface image in sections to obtain compressed data, so as to transmit the compressed data to the data storage unit.
[0038] Specifically, the real-time data acquisition unit may include sensors provided on each device in the production line, and a visual camera for acquiring product surface images. The production line equipment data when the production line equipment is working can be acquired in real time through multi-source sensors, and the original product surface image can be acquired in real time through the visual camera. After obtaining the original product surface image, the optimal frame can be selected from multiple frames of images, which can be an image with higher clarity, and edge computing can be performed on the original product surface image, which can significantly reduce the delay of data transmission, reduce the amount of data transmission, and thus save network bandwidth and storage resources.
[0039] When data is being transmitted, the transmission unit can be used to segment and compress the production line equipment data and product surface images to obtain compressed data, so as to transmit the compressed data to the data storage unit. For example, the production line equipment data and product surface images can be segmented and compressed according to the data acquisition time. Alternatively, according to the production line process, the equipment data and product data of multiple production line nodes under a single process can be divided into one section for compression. It should be noted that data storage is the basis of data analysis and utilization. By calling the data in the database, real-time query and historical information tracing of intelligent production line data can be realized. At the same time, relying on the large amount of data stored in the database, it is possible to reproduce historical operation scenes, complete remote online monitoring of equipment, real-time warning of equipment operation status, predictive diagnosis and maintenance of system failures and other functions.
[0040] It is understandable that the node data information of each physical device of the production line can be collected and transmitted in real time, mapped one by one to the virtual digital twin model, and the real-time status monitoring of various manufacturing-related indicators under the operation status of the production line-related equipment can be realized, such as the number, position, angle, speed, posture, following error and sensor data of the equipment parts, etc., for analysis, calculation and processing, and the Excel software can be used to display them in real time in the form of dynamic two-dimensional charts to realize the function of health management of production line equipment. VR / AR (Virtual Reality; Augmented Reality) technology can also be applied to upload the data of each device obtained from the physical production line to the Internet of Things platform with the help of the Internet of Things platform, and remote online real-time monitoring can be carried out by logging in to the web interface and the mobile phone to enhance the user experience.
[0041] The method provided by the embodiment of the present invention performs edge computing and segmented compression processing on the real-time collected data to reduce the transmission volume of real-time data, improve the data interaction efficiency of the real-time monitoring system of the automobile wheel hub production line based on digital twins, and thus ensure the normal operation of each module of the system.
[0042] Based on any of the above embodiments, the transmission unit is further specifically configured to: Acquire a network bandwidth of a data transmission network, and when the network bandwidth is lower than a preset threshold, transmit the compressed data to the data storage unit based on a data transmission priority; The data transmission priority is determined based on the process difficulty of each production unit of the automobile wheel hub production line.
[0043] Specifically, when the transmission unit performs data transmission, the network bandwidth of the current data transmission network can be obtained preferentially. When the network bandwidth is lower than a preset threshold, it indicates that the current network state is unstable, and the compressed data can be transmitted to the data storage unit according to the data transmission priority. When the network bandwidth is higher than the preset threshold, it indicates that the current network state is good, and all compressed data can be transmitted to the data storage unit. It should be noted that the data transmission priority here can be determined based on the process difficulty of each production unit of the automobile wheel hub production line. It can be understood that in the automobile wheel hub production line, the production requirements of the key processes are often more stringent, and the process difficulty of its production unit is greater, and the corresponding importance of its production equipment data and product surface data is higher. Therefore, the higher the process difficulty of each production unit, the higher the priority of its corresponding entity data; conversely, the lower the priority of its corresponding entity data.
[0044] The method provided by the embodiment of the present invention determines the data transmission priority through the process difficulty of each production unit of the automobile wheel hub production line, so that when data is transmitted, the compressed data is transmitted according to the priority through the network bandwidth of the data transmission network and the data transmission priority, thereby ensuring the priority transmission of key equipment data, thereby ensuring real-time monitoring of key equipment data and improving the reliability of the real-time monitoring system of the automobile wheel hub production line based on digital twins.
[0045] Based on any of the above embodiments, the real-time data acquisition unit is specifically used for: Connecting multiple source sensors in various production units of the automobile wheel hub production line based on industrial Ethernet to form a communication channel; Based on the software built-in protocol driver, the data address of each device in the automobile wheel hub production line is obtained in an addressing manner on the communication channel to collect the production line equipment data and the original product surface image in real time.
[0046] Specifically, industrial Ethernet can be used on the host computer to connect PLC (Programmable Logic Controller), visual inspection, sensors, industrial robot controllers, machine tool motion controllers and other devices connected to the switch to form a communication channel. Then, the data address of the production line equipment can be obtained in an addressing manner based on the established industrial Ethernet communication channel through the built-in protocol driver of the IO Server software, and stored in the constructed OPC UA server address space. In addition, the data of the offline simulation process of the virtual workshop can be collected in real time through the simulation driver protocol. Finally, for devices that cannot collect data using the built-in OPC UA server of third-party software, an embedded OPC UA server can be used for data collection. The underlying equipment can be connected through a data collection development board, and the underlying data protocol conversion program and OPC UA server program can be written in the data collection development board. The data collected by the underlying sensors, servo drives, transmission controllers, RFID (Radio-Frequency Identification, wireless radio frequency identification technology) and other data can be converted and connected to the embedded OPC UA server and saved in the address space. The data can be transmitted to the OPC UA client through the wireless LAN, thereby realizing the perception, collection and transmission of physical production line equipment data, driving the synchronous operation of virtual and real production lines, and the production process of the virtual production line is a three-dimensional real-time visualization of the entire production operation status of the physical production line.
[0047] In one embodiment, Figure 2 Schematic diagram of data perception and interaction of the real-time monitoring system for automobile wheel hub production line provided by the present invention. Figure 2As shown, industrial Ethernet can be used on the host computer (PC) to connect PLC, visual inspection, sensors, industrial robot controllers, machine tool motion controllers and other devices connected to the switch to form a communication channel. In addition, through Simens TCP / IP driver, Modbus TCP / IP driver, ProfiNet driver, OPC UA, ProfiNet and other protocol drivers, real-time perception and acquisition of real-time data of each device at the bottom of each production unit of the physical production line. And collect simulation data for the digital twin production line system. By transmitting real-time data and simulation data to the database, data reading, data reception, data analysis, data storage and data visualization are realized based on ERP, MES, PDM, WMS, information management system, EXCEL and other modules in the production line service system. During the data transmission process, the data acquisition and transmission module transmits the entity data obtained based on the embedded OPC UA server and the underlying data conversion protocol through the wireless LAN. Among them, the underlying data protocol conversion program and OPC UA server program are written in the data acquisition development board, and the data collected by the underlying sensors, servo drives, transmission controllers, RFID, etc. are converted and connected to the embedded OPC UA server.
[0048] Based on any of the above embodiments, the digital twin system building module is specifically used for: Analyze the geometric and physical properties of each production unit of the automobile wheel production line and build a digital twin model; The digital twin model is laid out and constructed based on the physical layout of the automobile wheel hub production line, and the digital twin model is remodeled to construct a real-time monitoring system for the automobile wheel hub production line; The secondary modeling includes establishing the behavior attributes, logic attributes, communication interfaces and driver connection scripts of each device under each production unit.
[0049] Specifically, first, the geometric and physical properties of each production unit of the automobile wheel production line are analyzed to construct a digital twin model corresponding to each production unit. Then, the 3D model of each unit module of the production line constructed in the 3D software can be imported into the digital twin simulation software, such as PQ factory. Then, the digital twin model can be laid out and constructed based on the physical layout of the automobile wheel production line.
[0050] It is understandable that the production line layout of the digital twin system can be planned according to the two-dimensional layout of the physical production line, or the layout of the production line can be optimized and adjusted according to the debugging simulation results of the digital twin system to improve the production efficiency of the production line. Alternatively, the motion trajectory of each device on the production line can be planned and the process flow can be virtually debugged according to process requirements. Thus, the simulation optimization of the production line process and its production rhythm can be completed in a virtual environment. Alternatively, according to the needs of production scheduling, the production plan information, process data information, production process data and warehousing planning data of the production line can be extracted, analyzed, and optimized, and the feedback data can be transmitted to the digital twin system for simulation verification to achieve intelligent production scheduling such as production process optimization, process optimization and intelligent warehousing, and predictive production.
[0051] Then, the digital twin model is remodeled, that is, the behavioral attributes, logical attributes, communication interfaces, and driver connection scripts of each production unit and each device are established, and PLC control programs and robot motion trajectory programs are written to simulate the production process and production plan, so as to achieve high-fidelity mapping modeling of the digital twin production line to the physical production line equipment, that is, to build a high-fidelity digital twin system.
[0052] It should be noted that the real-time monitoring system for automobile wheel hub production lines based on digital twins also includes a virtual-real variable binding unit. The virtual-real variable binding unit completes signal definition and virtual-real variable binding through the digital twin software, and is used to define each interface control signal, and to interface match the underlying data of each unit of the production line with the simulation data of the digital twin model. Through the established OPC UA S / C data transmission structure, the variables such as the data, signals, and states collected by the physical production line are interface matched and bound with the data variables corresponding to the digital twin model constructed in the digital twin simulation software, completing the one-to-one correspondence and data transmission of the physical production line data to the digital twin virtual production line.
[0053] The system provided by the embodiment of the present invention introduces digital twin technology into the intelligent manufacturing production line of automobile wheel hubs, builds a digital twin intelligent production line that synchronizes the real and virtual, can well solve the complex and uncertain problems arising in the manufacturing process of automobile wheel hubs, and realize three-dimensional real-time monitoring of automobile wheel hub production. It solves the problems of low real-time visualization of the operation process and production information of the automobile wheel hub production line, and difficulty in equipment data collection, thereby improving the production efficiency and management and control capabilities of automobile wheel hub manufacturers, and providing a solution for the application of digital twin technology in the field of intelligent manufacturing production of automobile hubs.
[0054] Based on any of the above embodiments, Figure 3 This is the second structural schematic diagram of the real-time monitoring system for automobile wheel hub production line based on digital twin provided by the present invention, such as Figure 3As shown in the figure, the real-time monitoring system of the automobile wheel hub production line can realize three functions, namely: production line planning and design function, operation and maintenance function, and auxiliary function. Among them, the production line planning and design function includes production line process layout design and production line virtual debugging. The operation and maintenance function includes real-time monitoring of all elements of the production line, intelligent production scheduling of the production line, production line equipment failure prediction, production line equipment health management, and production line quality monitoring and traceability. Auxiliary functions include mobile applications and AR / VR.
[0055] Based on any of the above embodiments, Figure 4 is an operation flow chart of the real-time monitoring system for automobile wheel hub production line based on digital twin provided by the present invention, such as Figure 4 As shown in the figure, the real-time monitoring system of the automobile wheel hub production line includes a physical production line, a digital twin space, an Internet of Things platform, a database, and a production line service system. Specifically, first, based on the geometric data of the production line equipment of the physical production line and CATIA\UG\SW (Computer-Aided Three-Dimensional Interactive Application\Unigraphics\SolidWorks), the shape, size, assembly constraint relationship, etc. of the production line equipment are modeled and rendered to construct an industrial robot model, a processing unit model, a polishing unit model, a detection unit model, a sorting unit model, a storage unit model, and a master control unit model. Then, the three-dimensional model is imported into the digital twin space to model the properties of the production line equipment, such as physics, behavior, and motion logic, the layout of the production line equipment, the real-time mapping of the data-driven production line, the production plan of the production line, and the simulation of the production process.
[0056] Among them, the physical production line includes industrial robots, processing units, grinding units, inspection units, sorting units, storage units, master control units, as well as PLC control programs, industrial computers, motion controllers, RFID, sensors, OPC UA, and their corresponding drivers, namely: Siemens TCP / IP driver, Modbus TCP / IP driver, ProfiNet driver, OPC UA driver, and other device drivers. The entity data is collected through the data acquisition device driver, embedded data acquisition module, OPC UA server, and IO Server software built-in protocol driver, and the entity data and twin data are transmitted and stored in the database. When necessary, data can be transmitted and exchanged from the database to realize data call. Twin data can also be analyzed and processed through Excel. In addition, data transmission is connected through the established OPC UA server with the digital twin simulation software and the OPC UA client to form the data transmission structure of the OPC UA server / client (ie, OPC UA S / C).
[0057] Here, the collected physical data and twin data can be used through the Internet of Things platform, such as IPDA / mobile phone or PC / large screen, to remotely monitor and display production equipment and data in real time. The production line service system modules here include ERP, MES, PDM, WMS, etc. Through the ERP, MES, PDM, and WMS systems, data transmission and exchange are carried out, and the data obtained from the physical production line and the digital twin production line are analyzed, stored, and optimized, which can realize the functions of production line data integration analysis, production scheduling, real-time decision-making, inventory management and optimization. It is also possible to realize robot grinding trajectory optimization, automobile wheel surface defect detection, wheel processing quality traceability reasoning, and digital twin production line production process visualization based on the digital twin space.
[0058] Based on any of the above embodiments, Figure 5 It is the work flow chart of the automobile wheel hub production line provided by the present invention, such as Figure 5 As shown, the system can realize equipment monitoring, order tracking, data visualization, inventory monitoring, and report statistics. The system includes: system management module, production execution module, production data module, production scheduling module, equipment management module, and logistics management module. Among them, the system management module includes user management, authority management, organization management, personnel management, role management, and menu management. The production execution module includes production planning, task issuance, start-up operations, production flow, and completion of operations. The production data module contains product information, material information, process information, process flow, operation instructions, and personnel information. Information is imported into the production execution module through the system management module and the production data module to execute production.
[0059] The production scheduling module includes user management, authority management, organization management, personnel management, role management, and menu management. The equipment management module includes: equipment information, data collection, status monitoring, equipment scheduling, execution feedback, and repair and maintenance. The logistics management module includes ledger management, warehousing plan, production and delivery, logistics tracking, and document confirmation. Information is fed into the equipment management module through the production scheduling module and the logistics management module, and the equipment management module interacts with the production execution module.
[0060] Based on any of the above embodiments, Figure 6 is the control logic diagram of the automobile wheel hub production line provided by the present invention, such as Figure 6As shown in the figure, the production line control system includes: the central control station PC (PQfactory), which is responsible for monitoring and coordinating the work of each production unit, and communicates with each device (such as PLC, IO Server, etc.) through the OPC UA protocol. The CNC system host and the CNC system PLC communicate internally, the CNC system host communicates with the IO Server through the OPC UA protocol, and the CNC system PLC communicates with the processing unit through the input and output I / O module. The entire production line includes a storage unit, a sorting unit, an execution unit, a grinding unit, and a processing unit. The units in the production line realize the collaborative work between devices through the ProfiNet communication protocol. Among them, the execution unit specifically includes the end tool, industrial robot, detection unit, and execution unit (servo slide), and each unit has a corresponding PLC or control module for precise control.
[0061] Based on any of the above embodiments, Figure 7 : is a flow chart of a real-time monitoring method for an automobile wheel hub production line based on digital twins provided by the present invention, such as Figure 7 As shown, the method includes: Step 710, analyzing the geometric properties and physical properties of each production unit of the automobile wheel hub production line to obtain a digital twin model, so as to construct a digital twin system; Step 720, collecting the physical data of the automobile wheel hub production line in real time, and transmitting the physical data to a data storage unit; the physical data includes production line equipment data and product surface images; Step 730, extracting features from the entity data based on the fault prediction model to obtain fault features, performing fault identification based on the fault features to obtain fault identification results, and displaying based on the fault identification results and the entity data; the fault prediction model is obtained by training based on the sample entity data and an initial fault prediction model based on a neural network; Step 740, based on the simulation data of the digital twin system and the entity data, jointly debug the real-time monitoring system of the automobile wheel hub production line as described in any of the above embodiments, and iteratively optimize the real-time monitoring system of the automobile wheel hub production line based on the joint debugging result.
[0062] The real-time monitoring method of the automobile wheel hub production line based on digital twin provided by the embodiment of the present invention enhances data interaction by constructing a digital twin system corresponding to the automobile wheel hub production line. On this basis, feature extraction is performed on the production line equipment data and product surface images based on the fault prediction model to perform fault identification, thereby achieving accurate and timely fault prediction, as well as efficient and real-time visual monitoring of the automobile wheel hub production line.
[0063] Figure 8An example of a physical structure diagram of an electronic device is shown in FIG. Figure 8 As shown, the electronic device may include: a processor (processor) 810, a communication interface (Communications Interface) 820, a memory (memory) 830 and a communication bus 840, wherein the processor 810, the communication interface 820, and the memory 830 communicate with each other through the communication bus 840. The processor 810 can call the logic instructions in the memory 830 to execute a real-time monitoring method for an automobile wheel hub production line based on a digital twin, the method comprising: performing geometric and physical property analysis on each production unit of the automobile wheel hub production line to obtain a digital twin model to construct a digital twin system; real-time acquisition of entity data of the automobile wheel hub production line, and transmitting the entity data to a data storage unit; the entity data includes production line equipment data and product surface images; feature extraction of the entity data based on a fault prediction model to obtain fault features, to perform fault identification based on the fault features, to obtain fault identification results, and to display based on the fault identification results and the entity data; the fault prediction model is obtained by training based on sample entity data and an initial fault prediction model based on a neural network; based on the simulation data of the digital twin system and the entity data, the real-time monitoring system for the automobile wheel hub production line as described in any of the above embodiments is jointly debugged, and the real-time monitoring system for the automobile wheel hub production line is iteratively optimized based on the joint debugging results.
[0064] In addition, the logic instructions in the above-mentioned memory 830 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.
[0065] On the other hand, the present invention also provides a computer program product, which includes a computer program, which can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the real-time monitoring method of an automobile wheel hub production line based on digital twins provided by the above methods, the method including: performing geometric and physical property analysis on each production unit of the automobile wheel hub production line to obtain a digital twin model to construct a digital twin system; real-time acquisition of entity data of the automobile wheel hub production line, and transmitting the entity data to a data storage unit; the entity data includes production line equipment data and product surface images; feature extraction of the entity data based on a fault prediction model to obtain fault features, to perform fault identification based on the fault features, to obtain fault identification results, and to display based on the fault identification results and the entity data; the fault prediction model is obtained by training based on sample entity data and an initial fault prediction model based on a neural network; based on the simulation data of the digital twin system and the entity data, the real-time monitoring system of the automobile wheel hub production line as described in any of the above embodiments is jointly debugged, and the real-time monitoring system of the automobile wheel hub production line is iteratively optimized based on the joint debugging results.
[0066] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the real-time monitoring method for an automobile wheel hub production line based on digital twins provided by the above-mentioned methods, the method comprising: performing geometric and physical property analysis on each production unit of the automobile wheel hub production line to obtain a digital twin model to construct a digital twin system; real-time acquisition of entity data of the automobile wheel hub production line, and transmitting the entity data to a data storage unit; the entity data includes production line equipment data and product surface images; feature extraction of the entity data based on a fault prediction model to obtain fault features, to perform fault identification based on the fault features, to obtain fault identification results, and to display based on the fault identification results and the entity data; the fault prediction model is obtained by training based on sample entity data and an initial fault prediction model based on a neural network; based on the simulation data of the digital twin system and the entity data, the real-time monitoring system for the automobile wheel hub production line as described in any of the above-mentioned embodiments is jointly debugged, and the real-time monitoring system for the automobile wheel hub production line is iteratively optimized based on the joint debugging results.
[0067] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.
[0068] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.
[0069] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A real-time monitoring system for automobile wheel hub production line based on digital twin, characterized in that: include: Digital twin system building module, real-time data acquisition and transmission module, monitoring module and simulation optimization module; The digital twin system construction module is used to analyze the geometric properties and physical properties of each production unit of the automobile wheel hub production line to obtain a digital twin model to construct a digital twin system; The real-time data acquisition and transmission module is used to acquire the physical data of the automobile wheel hub production line in real time and transmit the physical data to a data storage unit; the physical data includes production line equipment data and product surface images; The monitoring module is used to extract features from the entity data based on the fault prediction model to obtain fault features, identify faults based on the fault features, obtain fault identification results, and display based on the fault identification results and the entity data; The fault prediction model is obtained by training based on sample entity data and an initial fault prediction model based on a neural network; The simulation optimization module is used to jointly debug the real-time monitoring system of the automobile wheel hub production line based on the simulation data of the digital twin system and the entity data, and to iteratively optimize the real-time monitoring system of the automobile wheel hub production line based on the joint debugging results.
2. The real-time monitoring system for automobile wheel hub production line based on digital twin according to claim 1 is characterized in that: The monitoring module includes a fault prediction unit, which is specifically used to: Acquiring abnormal equipment data from the production line equipment data, and performing image detection on the product surface image to obtain a detection positioning image; Extracting features from the abnormal equipment data and the detection positioning image based on the fault prediction model to obtain the fault features, and performing fault identification based on the fault features to obtain a fault identification result; The fault characteristics include equipment fault characteristics and product defect characteristics.
3. The real-time monitoring system for automobile wheel hub production line based on digital twin according to claim 1 is characterized in that: The real-time data acquisition and transmission module includes a real-time data acquisition unit and a transmission unit; The real-time data acquisition unit is used to acquire the production line equipment data and the original product surface image in real time, and perform edge computing on the original product surface image to obtain the product surface image; The transmission unit is used to compress the production line equipment data and the product surface image in sections to obtain compressed data, so as to transmit the compressed data to the data storage unit.
4. The real-time monitoring system for automobile wheel hub production line based on digital twin according to claim 3 is characterized in that: The transmission unit is further specifically used for: Acquire a network bandwidth of a data transmission network, and when the network bandwidth is lower than a preset threshold, transmit the compressed data to the data storage unit based on a data transmission priority; The data transmission priority is determined based on the process difficulty of each production unit of the automobile wheel hub production line.
5. The real-time monitoring system for automobile wheel hub production line based on digital twin according to claim 3 is characterized in that: The real-time data acquisition unit is specifically used for: Connecting multiple source sensors in various production units of the automobile wheel hub production line based on industrial Ethernet to form a communication channel; Based on the software built-in protocol driver, the data address of each device in the automobile wheel hub production line is obtained in an addressing manner on the communication channel to collect the production line equipment data and the original product surface image in real time.
6. The real-time monitoring system for automobile wheel hub production line based on digital twin according to any one of claims 1 to 5, characterized in that: The digital twin system building module is specifically used for: Analyze the geometric and physical properties of each production unit of the automobile wheel production line and build a digital twin model; The digital twin model is laid out and constructed based on the physical layout of the automobile wheel hub production line, and the digital twin model is remodeled to construct the digital twin system; The secondary modeling includes establishing the behavior attributes, logic attributes, communication interfaces and driver connection scripts of each device under each production unit.
7. A real-time monitoring method for an automobile wheel hub production line based on digital twins, characterized in that: include: Analyze the geometric and physical properties of each production unit of the automobile wheel production line to obtain a digital twin model and build a digital twin system; Collecting the physical data of the automobile wheel hub production line in real time, and transmitting the physical data to a data storage unit; the physical data includes production line equipment data and product surface images; Extracting features from the entity data based on the fault prediction model to obtain fault features, identifying faults based on the fault features to obtain fault identification results, and displaying the fault identification results and the entity data; The fault prediction model is obtained by training based on sample entity data and an initial fault prediction model based on a neural network; Based on the simulation data of the digital twin system and the entity data, the real-time monitoring system for an automobile wheel hub production line as described in any one of claims 1 to 6 is jointly debugged, and based on the joint debugging result, the real-time monitoring system for an automobile wheel hub production line is iteratively optimized.
8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, it implements the real-time monitoring method of the automobile wheel hub production line based on digital twin as described in claim 7.
9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by the processor, the real-time monitoring method of the automobile wheel hub production line based on digital twin as claimed in claim 7 is implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by the processor, the real-time monitoring method of the automobile wheel hub production line based on digital twin as claimed in claim 7 is implemented.
Citation Information
Patent Citations
A fault online detection system and method applied to an intelligent manufacturing workshop
CN109840900A
Hub molding hydraulic press production line fault diagnosis system
CN111708334A
Digital twinning system and method for personalized product-in-process customization production line
CN116523119A
Sawing machine production fault prediction method and equipment based on Internet of Things, and medium
CN118364422A
Cited By
Fault diagnosis method, device and equipment based on digital twinning and storage medium
CN120029216A
Simulation monitoring method and device for vehicle intelligent cabin production line
CN120428671A
Hub machining multi-station cooperative control system based on industrial internet
CN120595759A
An automobile hub production line monitoring system based on internet of things
CN122883805A
