Visual monitoring method and system for blade machining process based on digital twinning
Through digital twin technology and real-time data processing, efficient and intuitive monitoring of the blade processing process is achieved, and the problems of real-time and data synchronization in traditional monitoring methods are solved, data stability and accuracy are improved, and digital twin model and reality are ensured. Synchronization of state.
Patent Information
- Application Number
- CN202410927770.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-11
- Publication Date
- 2024-11-08
AI Technical Summary
Traditional blade processing monitoring methods cannot provide real-time and intuitive feedback, and it is difficult to integrate multi-dimensional data and display it in real time. The technical means of data synchronization and real-time update are not enough to keep the digital twin model synchronized with the actual processing process.
Using the visual monitoring method of blade processing process based on digital twins, the three-dimensional model of blade processing production line equipment is constructed, and equipment data is collected in real time and preprocessed. After processing using the matching mechanism of timestamp synchronization combined with interpolation algorithm, the data is input in real time to In the digital twin model, real-time updates are achieved through WebSocket and 3D drawings are used for visual monitoring using WebGL.
It realizes efficient and intuitive digital monitoring of the blade processing process, improves data stability and accuracy, keeps the digital twin model highly synchronized with the actual state, and provides more efficient processing control.
Smart Images

Figure CN118915638A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a method for visually monitoring a blade processing process, and relates to the technical fields of intelligent manufacturing and digital twins, and in particular to a method and system for visually monitoring a blade processing process based on digital twins. Background Art
[0002] In recent years, digital twin technology has been widely used in the industrial field. It reflects the state of physical systems in real time through digital models, providing a powerful tool for real-time monitoring and optimization. Traditional processing monitoring methods often rely on offline analysis and cannot provide real-time and intuitive feedback. At the same time, the processing process involves multi-dimensional data, including geometric parameters, process parameters, and mechanical status. How to integrate these data and display them in real time on a visualization platform is also a problem faced by current technology. In addition, the technical means of data synchronization and real-time updating still need to be improved to ensure that the digital twin model is closely synchronized with the actual blade processing process. Summary of the invention
[0003] In order to solve the problems existing in the background technology, the present invention provides a blade processing process visualization monitoring method and system based on digital twin. The present invention is used to provide an efficient and intuitive digital twin model update and visualization display method, providing an efficient and intelligent digital solution for production and processing, and pushing digital twin technology into new application fields.
[0004] The technical solution adopted by the present invention is:
[0005] 1. A visual monitoring method for blade processing based on digital twins:
[0006] Step 1: Construct a 3D model of the blade processing production line equipment.
[0007] Step 2: Collect the equipment data of the blade processing production line equipment in the blade processing process in real time and pre-process it, and then use the timestamp synchronization combined with the specific matching mechanism of the interpolation algorithm to obtain the matched equipment data.
[0008] Step 3: Input the acquired matched equipment data into the three-dimensional model of the blade processing production line equipment in real time, so as to construct a real-time updated digital twin model that is synchronized with the actual blade processing status of the blade processing production line equipment; realize real-time data update by using WebSocket to ensure timely update of the digital twin model.
[0009] Step 4: Perform real-time visualization of the actual application scenario of each blade processing production line equipment in the blade processing process according to the overall layout to achieve visual monitoring of the blade processing process.
[0010] In the step 2, the equipment data of the blade processing production line equipment during the blade processing process includes temperature, pressure, vibration and speed data, etc. The equipment data is sampled according to a preset sampling frequency; the equipment data is preprocessed, specifically, the median filter of the filtering algorithm is used to perform noise reduction on the equipment data to eliminate noise caused by sensor errors or other reasons of the blade processing production line equipment.
[0011] In the step 2, the preprocessed device data is processed using a specific matching mechanism that combines timestamp synchronization with an interpolation algorithm. Specifically, a timestamp is added to each data point in the preprocessed device data, and then the spline interpolation of the interpolation algorithm is used to fill the time difference between the data points in the preprocessed device data. Then, a matching time point is determined at each time point, and finally the matched device data is obtained, ensuring that each data point is accompanied by an accurate timestamp.
[0012] In step 4, the real-time updated digital twin model of each blade processing line equipment is visualized in real time on the Web side according to the actual application scenario, using a Web-based 3D drawing method (Web Graphics Library, WebGL) according to the overall layout of each blade processing line equipment in the blade processing process. The model is loaded and rendered using the Three.js library in WebGL, and the camera and point light source are set to ensure a suitable viewing angle.
[0013] 2. A visual monitoring system for blade processing:
[0014] The physical workshop layer includes various blade processing production line equipment and a data perception module. The data perception module collects the equipment data of each blade processing production line equipment during the blade processing process in real time, and then pre-processes the collected equipment data and uses a specific matching mechanism that combines timestamp synchronization with an interpolation algorithm to obtain the matched equipment data and transmit it to the database for storage.
[0015] At the virtual workshop level, a high-fidelity rendered 3D model of each blade processing production line equipment is established. Then, a digital twin model is constructed based on the matched equipment data in the database, and the overall layout is constructed.
[0016] At the application layer, the matched equipment data stored in the database is updated to the WEB end in real time through WebSocket. Through the Web-based 3D drawing method, according to the overall layout of each blade processing production line equipment in the blade processing process, the real-time updated digital twin model of each blade processing production line equipment is visualized in real time on the Web end according to the actual application scenario, so that the digital twin model is synchronized with the actual blade processing status of the blade processing production line equipment, and 3D model interaction and visualization of the matched equipment data are performed to achieve visual monitoring of the blade processing process.
[0017] The beneficial effects of the present invention are:
[0018] 1) The present invention uses digital twin technology to digitally represent the blade processing process, and through real-time monitoring and visual display, it can achieve easy and accurate control of the processing process, which is more efficient than traditional monitoring methods.
[0019] 2) The present invention processes the original data through a median filtering noise reduction algorithm, thereby improving the stability and accuracy of the data.
[0020] 3) The present invention adopts a matching mechanism of timestamp synchronization combined with an interpolation algorithm to fill the time difference between data points, so that the digital twin model can be highly synchronized with the state of the physical entity. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] Figure 1 A schematic diagram of the architecture of a blade processing visualization monitoring system based on digital twins provided in an embodiment of the present invention;
[0022] Figure 2 A schematic diagram of a digital twin model provided by an embodiment of the present invention, wherein: Figure 2 (a) is a schematic diagram of a DMG digital twin model provided in an embodiment of the present invention, Figure 2 (b) is a schematic diagram of the digital twin model of Huaya machine tools provided in an embodiment of the present invention;
[0023] Figure 3 A schematic diagram of a real-time matching mechanism flow chart provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0024] The present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. However, it should be understood that the implementation method described below is only used to explain the present invention and is not limited to the present invention. The present invention is described in detail below, and through these detailed descriptions, those skilled in the art can fully understand the present invention.
[0025] The blade processing visualization monitoring method based on digital twin of the present invention is as follows:
[0026] Step 1: Construct a three-dimensional model of the blade processing production line equipment; the blade processing production line equipment includes industrial computers, sensors, Huaya machine tools, ABB robots, DMG machine tools, Fanuc robots, three-coordinate detection equipment, etc.
[0027] Step 2: Collect the equipment data of the blade processing production line equipment in the blade processing process in real time and pre-process it, and then use the timestamp synchronization combined with the specific matching mechanism of the interpolation algorithm to obtain the matched equipment data.
[0028] The equipment data of the blade processing production line equipment during the blade processing process includes temperature, pressure, vibration and speed data, etc. The equipment data is sampled according to a preset sampling frequency; the equipment data is preprocessed, specifically, the median filter of the filtering algorithm is used to perform noise reduction on the equipment data to eliminate the noise caused by sensor errors or other reasons of the blade processing production line equipment.
[0029] like Figure 3 As shown, the preprocessed device data is processed by a specific matching mechanism combining timestamp synchronization with an interpolation algorithm. Specifically, a timestamp is added to each data point in the preprocessed device data, and then the spline interpolation of the interpolation algorithm is used to fill the time difference between the data points in the preprocessed device data. Then, the matching time point is determined at each time point, and finally the matched device data is obtained, ensuring that each data point is accompanied by an accurate timestamp.
[0030] Step 3: Input the acquired matched equipment data into the three-dimensional model of the blade processing production line equipment in real time, so as to construct a real-time updated digital twin model that is synchronized with the actual blade processing status of the blade processing production line equipment; realize real-time data update by using WebSocket to ensure timely update of the digital twin model.
[0031] Step 4: Perform real-time visualization of the actual application scenario of each blade processing production line equipment in the blade processing process according to the overall layout to achieve visual monitoring of the blade processing process.
[0032] Through the 3D drawing method based on the Web end, according to the overall layout of each blade processing production line equipment in the blade processing process, the real-time updated digital twin model of each blade processing production line equipment is visualized in real time on the Web end according to the actual application scenario. The model is loaded and rendered using the Three.js library in WebGL, and the camera and point light source are set to ensure a suitable viewing angle.
[0033] like Figure 1As shown, the blade processing process visualization monitoring system of the present invention includes a physical workshop layer, a virtual workshop layer and an application layer. The physical workshop layer includes various blade processing production line equipment and a data perception module. The data perception module collects the equipment data of various blade processing production line equipment in the blade processing process in real time, and then pre-processes the collected equipment data and uses a specific matching mechanism of timestamp synchronization combined with an interpolation algorithm to obtain matched equipment data and transmit it to a database for storage; the virtual workshop layer uses SolidWorks and Blender software in turn to establish high-fidelity rendered three-dimensional models of various blade processing production line equipment, and then constructs a digital twin model based on the matched equipment data in the database, such as Figure 2 (a) and Figure 2 As shown in (b), the DMG digital twin model and the Huaya machine tool digital twin model provided in the embodiment of the present invention are used, and then the overall layout is constructed; the application layer updates the matched device data stored in the database to the WEB end in real time through WebSocket, and through the Web-based 3D drawing method, according to the overall layout of each blade processing production line equipment in the blade processing process, the real-time updated digital twin model of each blade processing production line equipment is visualized in real time on the Web end according to the actual application scenario, so that the digital twin model is synchronized with the actual blade processing status of the blade processing production line equipment, and 3D model interaction and visualization of the matched device data are performed to realize visual monitoring of the blade processing process.
[0034] In the specific implementation of the present invention, SolidWorks and Blender software are first integrated to design and process the three-dimensional model of the blade processing production line equipment, and SolidWorks is used to model the blade processing production line equipment, including geometric shapes and structural parameters. The modeling tool of SolidWorks is used to create an initial three-dimensional model, and detailed design is performed to meet the requirements. Subsequently, the model file processed by SolidWorks is exported to provide a data basis for subsequent work. Blender is introduced to further process the three-dimensional model, including importing the model file exported by SolidWorks, performing optimization processing and geometric adjustment, and finally exporting the final three-dimensional model processed by Blender. After completion, these processed three-dimensional models are stored in a unified model library, and the data structure and index of the model library are designed to support subsequent digital twin simulation and real-time monitoring. This process integrates two professional tools, SolidWorks and Blender, to ensure efficient and accurate design of blade processing.
[0035] Then use KepServer to collect equipment processing data in real time, including temperature, vibration and other parameters. Create a data channel in KepServer, connect it to the programmable logic controller (PLC) module of the blade processing equipment, and set the communication protocol and address information; add equipment tags for each processing parameter such as temperature and vibration, and ensure that each equipment tag corresponds to the corresponding data point in the PLC module one by one (these data points represent various data interfaces in the PLC module, which can be a register or an input / output point. For example, connect a temperature sensor to the input module of the PLC to collect temperature. By reading and writing these data points, the processing process can be monitored); for each parameter that needs to be collected, set the sampling frequency to ensure that sufficient real-time data is obtained.
[0036] Before storing the collected device data, use the filtering algorithm in signal processing, such as median filtering, to reduce the noise of the collected data to ensure that the stored data is more stable and reliable. Specifically, first obtain the signal data and initialize an empty array to store the signal data. For each data point, extract the data in the window with the current data point as the center. And determine whether the data in the window is out of bounds or invalid data. If it is not out of bounds or valid data, call the median filter function to calculate the median of the window data. Otherwise, continue to adjust the window size. Replace the original value in the window with the calculated median. Slide the window back one data point and repeat the above steps until the entire data sequence is processed. Different boundary processing methods can be used for the beginning and end of the sequence.
[0037] Then, by using WebSocket technology to achieve real-time data updates, the digital twin model can be updated in a timely manner. Through real-time matching mechanisms, such as the matching mechanism that uses timestamp synchronization combined with interpolation algorithms, the time difference between data points can be filled. Figure 3 As shown, add a timestamp to each data point of data from different data sources to ensure that the timestamps of all data sources are based on the same time standard. If the data sources are distributed in different devices or locations, ensure that their system clocks are synchronized, otherwise they need to be corrected so that the timestamps are consistent between different devices. You can use synchronization mechanisms such as the Network Time Protocol (NTP). Determine a target timeline, which can be a timestamp sequence of one of the data streams or a custom timestamp sequence. For each data stream, use an interpolation algorithm to interpolate on the target timeline to ensure that there is a corresponding data value at each time point. The interpolation method can be linear interpolation, spline interpolation, etc. Based on the matching of timestamps and interpolation, all data streams are matched in real time. At each time point, determine the matching data points to form a matching data set.
[0038] Then store the data in the MySQL database, create a data table in the MySQL database to store the blade processing data, define the field name and data type, insert or update the processed data into the corresponding table in the MySQL database, and set the data storage strategy, including the data update frequency, retention time, etc.
[0039] Finally, the digital twin model can be kept highly synchronized with the state of the actual system, and real-time visualization of the blade processing status can be provided through technologies such as WebGL. The model is loaded and rendered using the Three.js library in WebGL, while the scene and camera are set to ensure a suitable viewing angle.
[0040] The embodiment of the present invention also provides a blade processing process visualization monitoring system based on digital twins, including a physical workshop layer, a virtual workshop layer and an application layer. The physical workshop layer includes physical equipment such as DMG machine tools, ABB robotic arms, sensors, industrial computers and data perception modules. The data perception module collects various data during the blade processing process, such as temperature, pressure, vibration, speed, etc., and transmits the collected data to the database for further analysis and utilization. The virtual workshop layer uses SolidWorks and Blender to render a three-dimensional model of the physical equipment with high fidelity, and builds the overall layout. The application layer builds a blade processing visualization system on the WEB side to perform real-time monitoring of the blade processing production line; designs bar charts, pie charts, carousel tables, etc., and updates the data stored in the database to the WEB side through WebSocket. The digital twin model can be highly synchronized with the state of the physical entity, and finally realizes the 3D model interaction and equipment data visualization functions.
[0041] The above detailed description of the present invention is only a preferred embodiment and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.
Claims
1. A visual monitoring method for blade processing based on digital twin, characterized in that: include: Step 1: Build a 3D model of the blade processing production line equipment; Step 2: Collect the equipment data of the blade processing production line equipment in the blade processing process in real time and pre-process it, and then use the specific matching mechanism of timestamp synchronization combined with interpolation algorithm to obtain the matched equipment data; Step 3: Input the acquired matched equipment data into the three-dimensional model of the blade processing production line equipment in real time, so as to construct a real-time updated digital twin model that keeps synchronization with the actual blade processing status of the blade processing production line equipment; Step 4: Perform real-time visualization of the actual application scenario of each blade processing production line equipment in the blade processing process according to the overall layout to achieve visual monitoring of the blade processing process.
2. The method for visual monitoring of blade processing based on digital twin according to claim 1 is characterized in that: In the step 2, the equipment data of the blade processing production line equipment during the blade processing process includes temperature, pressure, vibration and speed data, and the equipment data is sampled according to a preset sampling frequency; the equipment data is preprocessed, specifically, the median filtering of the filtering algorithm is used to reduce the noise of the equipment data.
3. The method for visual monitoring of blade processing based on digital twin according to claim 1, characterized in that: In the step 2, the preprocessed device data is processed using a specific matching mechanism that combines timestamp synchronization with an interpolation algorithm. Specifically, a timestamp is added to each data point in the preprocessed device data, and then the spline interpolation of the interpolation algorithm is used to fill the time difference between the data points in the preprocessed device data. Then, a matching time point is determined at each time point to finally obtain the matched device data.
4. The method for visual monitoring of blade processing based on digital twin according to claim 1, characterized in that: In the step 4, through the Web-based 3D drawing method, according to the overall layout of each blade processing production line equipment in the blade processing process, the real-time updated digital twin model of each blade processing production line equipment is visualized in real time on the Web according to the actual application scenario.
5. A blade processing visualization monitoring system suitable for the method according to any one of claims 1 to 4, characterized in that: include: The physical workshop layer includes various blade processing production line equipment and a data perception module. The data perception module collects the equipment data of various blade processing production line equipment in real time during the blade processing process, and then pre-processes the collected equipment data and uses a specific matching mechanism that combines timestamp synchronization with an interpolation algorithm to obtain the matched equipment data and transmit it to the database for storage; In the virtual workshop layer, a high-fidelity rendered 3D model of each blade processing production line equipment is established. Then, a digital twin model is constructed based on the matched equipment data in the database, and the overall layout is constructed. At the application layer, the matched equipment data stored in the database is updated to the WEB end in real time. Through the Web-based 3D drawing method, according to the overall layout of each blade processing production line equipment in the blade processing process, the real-time updated digital twin model of each blade processing production line equipment is visualized in real time on the Web end according to the actual application scenario, so that the digital twin model is synchronized with the actual blade processing status of the blade processing production line equipment, and 3D model interaction and visualization of the matched equipment data are performed to achieve visual monitoring of the blade processing process.
Citation Information
Cited By
Digital twinborn visualization method and system applied to digital metal structure processing
CN120540254A
