Multi-source data acquisition system and method for digital twin of material performance testing machine

Abstract

The present invention belongs to the technical field of test equipment manufacturing, specifically a multi-source data acquisition system and method for digital twins of material performance testing machines. The acquisition system includes a test instrument, a data acquisition edge gateway, a temporary database, an industrial computer, a publish / subscribe data transfer server and a digital twin server; the digital twin server is connected to the publish / subscribe data transfer server; the construction method includes: S1, building a publish / subscribe data transfer server; S2, publishing data to the publish / subscribe data transfer server; S3, publishing data to the publish / subscribe data transfer server through the temporary database; S4, publishing data to the publish / subscribe data transfer server through the industrial computer; S5, the digital twin server subscribes to the data of the publish / subscribe data transfer server. The present invention successfully connects a variety of data sources during the operation of the test instrument, and realizes the collection and aggregation of multi-source data.

Description

Technical Field

[0001] The present invention belongs to the technical field of testing equipment manufacturing, and specifically relates to a multi-source data acquisition system and method for digital twins of material performance testing machines. Background Art

[0002] A material performance testing instrument is a scientific instrument used to test the mechanical properties and other special properties of materials. It can monitor the test indicators of materials and its own operating parameters through ubiquitous sensors. Some test instruments have matching industrial control software and data storage databases. Building a digital twin of the test instrument can make the instrument operation process transparent, monitor the instrument operation status in real time, detect abnormal conditions in time and avoid unnecessary downtime. Building a digital twin requires collecting and analyzing data from multiple sources to achieve integrated analysis and processing of data.

[0003] The data sources of testing instruments can be broadly divided into material testing data and instrument operation data, and data acquisition plans often collect data separately for these two aspects, resulting in a lot of data only being displayed in industrial computers and sensor instruments. It is impossible to incorporate all data into a data system for analysis, and it is impossible to realize the digital twin of the testing instrument. The data transmission flexibility is not high, and there is a lack of overall technical solutions. Summary of the invention

[0004] To solve the above problems, the present invention provides a multi-source data acquisition system and method for digital twins of material performance testing machines, which can successfully connect various data sources of the test instrument during operation, realize the collection and aggregation of multi-source data, and ensure the lightweight of the server based on the publish / subscribe data transfer server. Through a variety of QoS levels, it is conducive to the reliable transmission of data in various difficult environments, and provides a data basis for the construction of digital twins, thereby assisting the staff to carry out maintenance and management of the test instruments, thereby avoiding the problem of product development delays due to test instrument failures.

[0005] The technical solution of the present invention is described as follows in conjunction with the accompanying drawings:

[0006] In a first aspect, the present invention provides a multi-source data acquisition system for a digital twin of a material performance testing machine, comprising:

[0007] Testing instruments, used to carry out material performance tests on the tested samples;

[0008] Data collection edge gateway, used for sensor data collection and publishing the collected data;

[0009] Temporary database, used to synchronize data with the database connected to the industrial control software, and publish data during synchronization;

[0010] Industrial computer, used to control the test functions of the test instrument and has data publishing function;

[0011] Publish / subscribe data transfer server, and receive various data released by data collection edge gateway, industrial computer, and temporary storage database;

[0012] Digital twin server, a server for building digital twin services, which monitors the real-time status and potential degradation of test instruments in a 3D visualization manner and subscribes to various data in the data transfer server;

[0013] The digital twin server is connected to a publish / subscribe data transfer server; the publish / subscribe data transfer server is connected to a data acquisition edge gateway, a temporary storage database and an industrial computer; the data acquisition edge gateway, the temporary storage database and the industrial computer are connected to the test instrument.

[0014] Furthermore, mechanical property data, thermal property data, chemical property data, environmental field temperature data, mechanical vibration data, current data, voltage data and potential data are obtained through material performance testing.

[0015] Furthermore, the data acquisition edge gateway has a sensor serial port access function and accesses a 485 / 232 serial port.

[0016] Further, the temporary database includes a master database and a slave database;

[0017] The master database is used to directly store all data collected from the test machine, and has a built-in binary log file to record data operations in the master database;

[0018] The slave database is used to perform data synchronization with the master database. It reads the data content in the master database by reading the binary log file of the master database to complete data synchronization.

[0019] In a second aspect, the present invention also provides a multi-source data acquisition method for a digital twin of a material performance testing machine, comprising the following steps:

[0020] S1. Build a publish / subscribe data transfer server;

[0021] S2, publish the data to the publish / subscribe data transfer server through the 485 / 232 serial port of the data acquisition edge gateway;

[0022] S3, monitor the test instrument database through the temporary database master-slave synchronization, and publish the data to the publish / subscribe data transfer server;

[0023] S4. Publish the data to the publish / subscribe data transfer server through the industrial computer;

[0024] S5. The digital twin server subscribes to the data of the publish / subscribe data transfer server.

[0025] Furthermore, the specific method of S1 is as follows:

[0026] 11) Initialize data transfer service;

[0027] Open the publish / subscribe data transfer service software, the software uses the MQTT protocol, and opens the MQTT service in the server that can be connected to by all other network devices through the TCP / IP protocol;

[0028] 12) Configure data transfer service;

[0029] Configure the IP address and port number in the MQTT service to avoid duplication with existing IP and port numbers. In addition, set the user information for connecting to the MQTT service and select the data transmission quality.

[0030] 13) Test data transfer service;

[0031] Use the test tool to publish and subscribe information to the MQTT server to ensure that the MQTT server works properly. If the data transfer server works properly, you can start the publish / subscribe data transfer server.

[0032] Furthermore, the specific method of S2 is as follows:

[0033] 21) Access sensor hardware;

[0034] Connect the sensor that transmits data through the 485 / 232 serial port to the data acquisition edge gateway;

[0035] 22) Categorize the data;

[0036] Formulate subject names for each type of data and classify them according to data categories;

[0037] 23) Convert data format;

[0038] Convert the data stream collected through the 485 / 232 serial port into JSON format data;

[0039] 24) Publish the data;

[0040] According to the IP address, listening port and data transmission quality set in 11), the topic name and corresponding data are published one by one.

[0041] Furthermore, the specific method of S3 is as follows:

[0042] 31) Configure the master database;

[0043] The master database has a built-in binary log file for recording change operations in the database;

[0044] 32) Configure the slave database;

[0045] The slave database specifies the IP address of the master database, the listening port number, the user name and password for user authentication, and the binary log file and position to be synchronized;

[0046] 33) Connect the master database and the slave database, and synchronize the information between the master database and the slave database;

[0047] Connect the slave database to the master database. The master database sends the binary log files to the slave database in the order and frequency of data collection. After receiving the binary log files, the slave database applies them to its own database to achieve data synchronization.

[0048] 34) Verify the consistency of data;

[0049] After synchronization is completed, a data consistency check is performed to ensure that the data in the slave database is consistent with the data in the master database;

[0050] 35) Categorize the data;

[0051] According to the different categories of material performance data, themes are compiled for each data to classify the data in the temporary database into different themes;

[0052] 36) Convert data format;

[0053] Convert the data stream to be transmitted into data in JSON format;

[0054] 37) Publish the data;

[0055] According to the IP address, listening port and data transmission quality set in 11), the topic name and corresponding data are published one by one.

[0056] Furthermore, the specific method of S4 is as follows:

[0057] 41) Build data publishing module;

[0058] Use the NuGet package manager to introduce the MQTTnet library into the IPC software; create an MQTT client in the IPC software to connect to the MQTT server and publish data; finally, test it by connecting to the MQTT server and testing the data publishing and subscription functions to ensure that it works as expected;

[0059] 42) Publish industrial computer data;

[0060] Open the MQTT client in the industrial computer; connect the MQTT client to the MQTT server; configure the topic content of the precision parameters and temperature control parameters according to the specific data, and publish the data of each topic to the MQTT server; finally, add an exception handling logic, that is, when a connection failure occurs in MQTT, the connection exception code is fed back to handle the exception when a connection failure occurs during the data publishing process.

[0061] Furthermore, the specific method of S5 is as follows:

[0062] 51) Subscribe to digital twin server data;

[0063] The digital twin service belongs to a test instrument monitoring method, which can perform three-dimensional visual monitoring according to various data of the test instrument; the digital twin service connects to the MQTT server according to various parameters in S1; then, according to the subject of the required data, the MQTT server is requested to subscribe to the data. After the subscription is requested, the MQTT server transmits the data published by each source to the digital twin server;

[0064] 52) Convert data format;

[0065] The digital twin server converts the JSON format data received from the MQTT server into a data stream in MySQL format;

[0066] 53) Storing data;

[0067] The data stream is stored in the database of the digital twin server for subsequent analysis.

[0068] The beneficial effects of the present invention are:

[0069] 1) The present invention can successfully connect various data sources of the test instrument during operation through the data transfer server, realize the collection and aggregation of multi-source data, and ensure the lightweight of the server based on the publish / subscribe data transfer server. And through a variety of QoS levels, it is conducive to reliable data transmission in various difficult environments;

[0070] 2) The present invention provides a data basis for the construction of digital twins through the effective collection of multi-source data. The twin instrument can obtain various data indicators of the physical instrument in real time, and calculate and analyze its invisible state based on the real-time data obtained, which is conducive to the maintenance of the test instrument, improves the operating stability and safety of the test instrument, and improves production efficiency and work benefits;

[0071] 3) The present invention improves the data collection quality by effectively integrating the data of the material testing machine, avoids the confusion of formats among various data, optimizes the workload in the data analysis process, and is beneficial to the real-time state identification and future state prediction of the testing machine. BRIEF DESCRIPTION OF THE DRAWINGS

[0072] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0073] Figure 1 This is a structural schematic diagram of a multi-source data acquisition system for a digital twin of a material performance testing machine according to the present invention;

[0074] Figure 2 This is a flow chart of a multi-source data acquisition method for a digital twin of a material performance testing machine described in the present invention. DETAILED DESCRIPTION

[0075] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0076] Embodiment 1: The present invention provides a multi-source data acquisition system for a digital twin of a material performance testing machine, comprising a testing instrument, a data acquisition edge gateway, a temporary storage database, an industrial computer, a publish / subscribe data transfer server, and a digital twin server;

[0077] The testing instrument is used to carry out material property testing on the tested sample. During the execution of the testing task, relevant data will be generated, specifically including material property data such as mechanical property data, thermal property data, chemical property data, etc. In addition, it also includes instrument operation data such as environmental field temperature data, mechanical vibration data, current data, voltage data, potential data, etc.

[0078] The data acquisition edge gateway is used for data acquisition of sensors and has a sensor serial port access function, which can access universal sensor serial ports such as 482 or 232. In addition, the data acquisition edge gateway has a certain computing capability and can publish the collected data.

[0079] The temporary database is a database independent of the industrial computer, which is generally built using a MySQL database and is used to synchronize data with the database connected to the industrial computer software and publish data during synchronization. The industrial computer is used to control the test function of the test instrument and has a data publishing function.

[0080] The temporary database includes a master database and a slave database;

[0081] The master database is used to directly store all data collected from the test machine, and has a built-in binary log file to record data operations of the master database;

[0082] The slave database is used to perform data synchronization with the master database. It reads the data content in the master database by reading the binary log file of the master database to complete data synchronization.

[0083] The publish / subscribe data transfer server is used to receive various types of data published by edge gateways, industrial computer software, temporary databases, etc. During the specific implementation process, the MQTT protocol is generally used to build a publish / subscribe server.

[0084] The digital twin server is a server used to build a digital twin service. It has high computing power and can monitor the real-time status and potential degradation of the test instrument in a three-dimensional visualization manner. In this invention, various data in the data transfer server can be subscribed.

[0085] The digital twin server is connected to a publish / subscribe data transfer server; the publish / subscribe data transfer server is connected to a data acquisition edge gateway, a temporary storage database and an industrial computer; the data acquisition edge gateway, the temporary storage database and the industrial computer are connected to the test instrument.

[0086] Embodiment 2: This embodiment provides a multi-source data acquisition method for a digital twin of a material performance testing machine, which specifically includes the following steps:

[0087] S1. Build a publish / subscribe data transfer server, as follows:

[0088] 11) Initialize data transfer service;

[0089] Start the publish / subscribe data transfer service software, the software uses the MQTT protocol, and starts the MQTT service in the server that can be connected by all other network devices through the TCP / IP protocol.

[0090] 12) Configure data transfer service;

[0091] Configure the IP address and port number of the service in the MQTT service. Avoid duplication with the existing IP and port number. In this implementation case, select port number 18038. In addition, set the user information connected to the service and select the data transmission quality. Select QoS2 to ensure data quality.

[0092] 13) Test data transfer service;

[0093] Use testing tools such as Mosquitto Broker to publish and subscribe to information to the MQTT server to ensure that the MQTT server is working properly.

[0094] S2. Publish the data to the publish / subscribe data transfer server through the 485 / 232 serial port of the data acquisition edge gateway, as follows:

[0095] 21) Access sensor hardware;

[0096] Connect the temperature sensor and pressure sensor to the edge gateway device via the 485 and 232 sensor serial ports.

[0097] 22) Categorize the data;

[0098] The data is named according to the temperature and water pressure, so that the data can be published to the MQTT server according to the topic name later.

[0099] 23) Convert data format;

[0100] The data format conversion method is integrated in the data acquisition edge gateway to convert the temperature and water pressure data streams into JSON format data streams that are easy to receive by MQTT.

[0101] 24) Publish the data;

[0102] According to the MQTT server IP address and port number set in S1, select the transmission quality of QoS2, and publish the temperature data and water pressure data to the MQTT server according to the topic.

[0103] S3, monitor the test instrument database through the temporary database master-slave synchronization, and publish the data to the publish / subscribe data transfer server, as follows:

[0104] 31) Configure the master database;

[0105] Enable the binary log file (binlog) of the master database to record changes in the database.

[0106] 32) Configure the slave database;

[0107] Specify the IP address, port number, user name and password of the master database in the slave database configuration, as well as the binary log file and position to be synchronized.

[0108] 33) Connect master-slave database and synchronize data;

[0109] First, the slave database is connected to the master database according to the above parameters. Second, the master database sends binary log events to the slave database in a certain order and frequency. Finally, after receiving the binary log events, the slave database applies them to its own database to achieve data synchronization.

[0110] 34) Check data consistency;

[0111] After synchronization is completed, a data consistency check is performed to ensure that the data in the slave database is consistent with the data in the master database.

[0112] 35) Categorize the data;

[0113] According to different data types, the data streams from the database are classified into different topics.

[0114] 36) Convert data format;

[0115] Convert the data stream to be transmitted into data in JSON format;

[0116] 37) Publish the data;

[0117] According to the IP address, port and data transmission quality in S1, the topics and corresponding data are published one by one.

[0118] S4. Publish the data to the publish / subscribe data transfer server through the industrial computer, as follows:

[0119] 41) Develop data publishing functions;

[0120] First, introduce the data publishing function library in the development of industrial computers; second, create a data publishing client to connect to the data transfer server and publish data; finally, test the data publishing function to ensure that the function works as expected.

[0121] 42) Release industrial computer data;

[0122] First, start the data publishing client; second, connect to the data transfer server according to the server information in S1; then, configure the required subject content and publish the data collected by the industrial computer from the test instrument; finally, add exception handling logic to perform appropriate processing when the connection fails or the message publishing fails.

[0123] S5. The digital twin server subscribes to the data of the publish / subscribe data transfer server, as follows:

[0124] 51) Subscribe to digital twin server data;

[0125] The digital twin service belongs to a test instrument monitoring method, which can perform three-dimensional visual monitoring according to various data of the test instrument; the digital twin service connects to the MQTT server according to various parameters in S1; then, according to the subject of the required data, the MQTT server is requested to subscribe to the data. After the subscription is requested, the MQTT server transmits the data published by each source to the digital twin server;

[0126] 52) Convert data format;

[0127] The digital twin server converts the JSON format data received from the MQTT server into a data stream in MySQL format;

[0128] 53) Storing data;

[0129] The data stream is stored in the database of the digital twin server for subsequent analysis.

[0130] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A multi-source data acquisition system for digital twin of material performance testing machine, characterized in that: include: Testing instruments, used to carry out material performance tests on the tested samples; Data collection edge gateway, used for sensor data collection and publishing the collected data; Temporary database, used to synchronize data with the database connected to the industrial control software, and publish data during synchronization; Industrial computer, used to control the test functions of the test instrument and has data publishing function; Publish / subscribe data transfer server, and receive various data released by data collection edge gateway, industrial computer, and temporary storage database; Digital twin server, a server for building digital twin services, which monitors the real-time status and potential degradation of test instruments in a 3D visualization manner and subscribes to various data in the data transfer server; The digital twin server is connected to a publish / subscribe data transfer server; the publish / subscribe data transfer server is connected to a data acquisition edge gateway, a temporary storage database and an industrial computer; the data acquisition edge gateway, the temporary storage database and the industrial computer are connected to a test instrument; The acquisition method of a multi-source data acquisition system for a digital twin of a material performance testing machine comprises the following steps: S1. Build a publish / subscribe data transfer server, as follows: 11) Initialize data transfer service; Open the publish / subscribe data transfer service software, the software uses the MQTT protocol, and opens the MQTT service in the server that can be connected to by all other network devices through the TCP / IP protocol; 12)Configure data transfer service; Configure the IP address and port number in the MQTT service to avoid duplication with existing IP and port numbers. In addition, set the user information for connecting to the MQTT service and select the data transmission quality. 13) Test data transfer service; Use the test tool to publish and subscribe information to the MQTT server to ensure that the MQTT server works properly. If the data transfer server works properly, you can start the publish / subscribe data transfer server. S2, publish the data to the publish / subscribe data transfer server through the 485 / 232 serial port of the data acquisition edge gateway; S3, monitor the test instrument database through the temporary database master-slave synchronization, and publish the data to the publish / subscribe data transfer server; S4. Publish the data to the publish / subscribe data transfer server through the industrial computer; S5. The digital twin server subscribes to the data of the publish / subscribe data transfer server.

2. A multi-source data acquisition system for digital twin of material performance testing machine according to claim 1, characterized in that: Mechanical property data, thermal property data, chemical property data, environmental field temperature data, mechanical vibration data, current data, voltage data and potential data are obtained through material performance testing.

3. The multi-source data acquisition system for digital twin of material performance testing machine according to claim 1, characterized in that: The data acquisition edge gateway has the function of sensor serial port access and access to the 485 / 232 serial port.

4. The multi-source data acquisition system for digital twin of material performance testing machine according to claim 1, characterized in that: The temporary database includes a master database and a slave database; The master database is used to directly store all data collected from the test machine, and has a built-in binary log file to record data operations in the master database; The slave database is used to perform data synchronization with the master database. It reads the data content in the master database by reading the binary log file of the master database to complete data synchronization.

5. The multi-source data acquisition system for digital twin of material performance testing machine according to claim 1, characterized in that: The specific method of S2 is as follows: 21) Access sensor hardware; Connect the sensor that transmits data through the 485 / 232 serial port to the data acquisition edge gateway; 22) Classify the data; Formulate subject names for each type of data and classify them according to data categories; 23) Convert the data format; Convert the data stream collected through the 485 / 232 serial port into JSON format data; 24) Publish the data; According to the IP address, listening port and data transmission quality set in 11), the topic name and corresponding data are published one by one.

6. The multi-source data acquisition system for digital twin of material performance testing machine according to claim 1, characterized in that: The specific method of S3 is as follows: 31) Configure the master database; The master database has a built-in binary log file for recording change operations in the database; 32) Configure the slave database; The slave database specifies the IP address of the master database, the listening port number, the user name and password for user authentication, and the binary log file and position to be synchronized; 33) Connect the master database and the slave database, and synchronize the information of the master database and the slave database; Connect the slave database to the master database; the master database sends the binary log files to the slave database according to the order and frequency of data collection; After receiving the binary log file from the database, apply it to your own database to achieve data synchronization; 34) Verify the consistency of data; After synchronization is completed, a data consistency check is performed to ensure that the data in the slave database is consistent with the data in the master database; 35) Classify the data; According to the different categories of material performance data, themes are compiled for each data to classify the data in the temporary database into different themes; 36) Convert the data format; Convert the data stream to be transmitted into data in JSON format; 37) Publish the data; According to the IP address, listening port and data transmission quality set in 11), the topic name and corresponding data are published one by one.

7. The multi-source data acquisition system for digital twin of material performance testing machine according to claim 1, characterized in that: The specific method of S4 is as follows: 41) Build data publishing module; Use the NuGet package manager to introduce the MQTTnet library into the IPC software; create an MQTT client in the IPC software to connect to the MQTT server and publish data; finally, test it by connecting to the MQTT server and testing the data publishing and subscription functions to ensure that it works as expected; 42) Publish industrial computer data; Open the MQTT client in the industrial computer; connect the MQTT client to the MQTT server; configure the topic content of the precision parameters and temperature control parameters according to the specific data, and publish the data of each topic to the MQTT server; finally, add an exception handling logic, that is, when a connection failure occurs in MQTT, the connection exception code is fed back to handle the exception when a connection failure occurs during the data publishing process.

8. The multi-source data acquisition system for digital twin of material performance testing machine according to claim 1, characterized in that: The specific method of S5 is as follows: 51) Subscribe to digital twin server data; The digital twin service belongs to a test instrument monitoring method, which can perform three-dimensional visual monitoring according to various data of the test instrument; the digital twin service connects to the MQTT server according to various parameters in S1; then, according to the subject of the required data, the MQTT server is requested to subscribe to the data. After the subscription is requested, the MQTT server transmits the data published by each source to the digital twin server; 52) Convert the data format; The digital twin server converts the JSON format data received from the MQTT server into a data stream in MySQL format; 53) Storing data; The data stream is stored in the database of the digital twin server for subsequent analysis.

Images