Laboratory instrument data automatic acquisition and analysis platform

Abstract

The invention discloses a laboratory instrument data automatic acquisition and analysis platform, which specifically comprises the following modules: a data acquisition module, which is used for acquiring data measured by an instrument in real time by performing data acquisition on the instrument, comprising the following steps: acquiring data by using a sensor, a data transmission interface and a camera; counting and adding a timestamp field in the acquisition process, and recording the starting time and the ending time of instrument measurement; in order to ensure the accuracy of the timestamp, the clocks of the sending end and the receiving end are synchronized through an NTP precise time protocol. By adopting automatic data acquisition, manual intervention is reduced, the data acquisition process is faster and more efficient, meanwhile, a data inspection unit is arranged, the logic relation between data is automatically verified, the consistency of different experiments or measurement results is ensured, and storage recording and backup of experiment data can be carried out.

Description

Technical Field

[0001] The present invention relates to the technical field of laboratory information management, and in particular to an automatic laboratory instrument data acquisition and analysis platform. Background Art

[0002] The data collection and analysis of laboratory instruments and equipment is a daily operation in the laboratory. It is usually done by manually checking the instrument data and manually recording it in the corresponding paper data record form or electronic data record form. It has gradually developed with the improvement of the automation degree of analytical and testing instruments, laboratory scale, and processing capacity. The rapid development of computer technology, especially the increasing maturity of network communication and database technology, has provided LIMS with an advanced technical platform and implementation means. The chemical analysis instruments in the laboratory are usually purchased as a whole from precision instrument manufacturing companies. Therefore, connections can be established with various chemical analysis instruments to realize automatic data collection of instruments and equipment.

[0003] However, the existing data collection process has at least the following technical problems: all instrument data are read manually, which is prone to data reading errors; and most existing collection systems use centralized one-time collection methods. Due to the large amount of experimental data, data collection and recording are difficult, the work intensity is high, and management data is out of control. Therefore, combining big data, artificial intelligence and Internet of Things technology can automatically identify instrument types and data protocols, realize automatic data recording, transmission and analysis, thereby improving data accuracy and reducing human errors. Summary of the invention

[0004] In view of the defects in the prior art, the present invention provides a laboratory instrument data automatic collection and analysis platform, which specifically includes the following modules:

[0005] A data acquisition module is used to collect data measured by the instrument in real time by performing data acquisition on the instrument;

[0006] When the data acquisition module collects data, it uses sensors, data transmission interfaces and cameras to collect data. At the same time, the timestamp field is added to the statistics during the collection process to record the start and end time of the instrument measurement. In order to ensure the accuracy of the timestamp, the clocks of the sender and receiver are synchronized through the NTP precise time protocol.

[0007] The data analysis module is used to clean, classify, verify, fuse and convert the data collected by the data collection module;

[0008] In the data preprocessing stage, the data analysis module cleans, extracts features and standardizes the original data. Feature extraction is the key step. The data analysis module constructs feature vectors based on the characteristics of the instrument itself, and performs unified division, fusion and classification of feature vector data according to the corresponding feature vectors. At the same time, the data analysis module uses the digital-to-analog conversion unit to perform data conversion processing;

[0009] The data storage unit is used to classify and store the data collected by the data acquisition module and the data processed by the data analysis module, and to centrally store the final analysis data.

[0010] Preferably, the laboratory instrument data automatic collection and analysis platform is connected to a server and a terminal. The server is responsible for receiving, storing and managing data collected from various laboratory instruments. At the same time, the server usually includes a user management function to ensure the access rights of different users to the data; the terminal device is usually connected to the laboratory instrument, responsible for real-time data collection and transmission to the server, and the terminal can provide a user interface to facilitate users to view real-time data, historical data and analysis results.

[0011] Preferably, the data analysis module is connected to an intelligent generation module, which generates an experimental statistical table using NLG technology based on the data processed by the data analysis module, wherein the experimental statistical table focuses on indicators such as material type and quality, and the experimental statistical table generates a sentence: "The mass of experimental group A is X, and Y equipment is used for grinding, melting or heating treatment."

[0012] Preferably, the data acquisition module includes a sensor unit, a transmission interface docking unit, a camera unit and a time period recording unit;

[0013] The sensor unit performs distributed transmission and fusion statistics based on distributed collaboration algorithms and data fusion mechanisms to speed up data collection and calculation;

[0014] The transmission interface docking unit uses a standard communication interface for connection and communication between the instrument and the terminal;

[0015] The camera unit uses a camera to directly capture and collect data.

[0016] Preferably, the data analysis module includes a data verification unit, a data fusion unit and a data conversion unit;

[0017] The data verification unit is used to verify the accuracy of the collected data in real time while collecting the data measured by the instrument in real time;

[0018] The data fusion unit uniformly divides and fuses the feature vector data according to the corresponding feature vectors, wherein the characteristics of the instrument itself include the instrument function and the instrument name.

[0019] Preferably, the data storage unit includes a single storage unit, a fusion storage unit and a central collection storage unit, wherein the single storage unit is used to store data information of each stage collected by the data collection unit;

[0020] The fusion storage unit is used to store the data information processed by the data analysis module, and the central collection storage unit is used to store the collection data information of the experimental statistical table generated by the intelligent generation module.

[0021] The beneficial effects of the present invention are embodied in:

[0022] 1. The use of automated data collection reduces manual intervention, making the data collection process faster and more efficient, reducing the risk of human error, and being able to monitor instrument data in real time, analyze data in a timely manner, and improve the response speed and efficiency of research work;

[0023] 2. The data verification unit monitors the accuracy of data in real time to ensure the quality of input data, reduce the amount of unqualified data entering the analysis phase, automatically verify the logical relationship between data, and ensure the consistency of different experimental or measurement results;

[0024] 3. By centrally storing all data in the database, it is easy to manage and search, and supports data backup and recovery. It can quickly connect with different types of instruments and equipment, integrate intelligent analysis for data analysis, and automatically generate data visualization reports for more intuitive understanding and display. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following is a brief introduction to the drawings required for the specific embodiments or the description of the prior art. In all the drawings, similar elements or parts are generally identified by similar reference numerals. In the drawings, the elements or parts are not necessarily drawn according to the actual scale.

[0026] Figure 1 It is a schematic diagram of the framework structure of the present invention;

[0027] Figure 2 It is a functional structure diagram of the data acquisition module of the present invention;

[0028] Figure 3 It is a schematic diagram of the process structure of the present invention. DETAILED DESCRIPTION

[0029] The following embodiments of the technical solution of the present invention are described in detail in conjunction with the accompanying drawings. The following embodiments are only used to more clearly illustrate the technical solution of the present invention, and are therefore only used as examples, and cannot be used to limit the protection scope of the present invention.

[0030] It should be noted that, unless otherwise specified, the technical terms or scientific terms used in this application should have the common meanings understood by those skilled in the art to which the present invention belongs.

[0031] like Figure 1-3 As shown, a laboratory instrument data automatic collection and analysis platform specifically includes the following modules:

[0032] The data acquisition module is used to collect data measured by the instrument in real time through data acquisition and data transmission modes. The data acquisition module directly interacts with the network interface and uses the MQTT real-time data transmission protocol to implement edge computing on the data acquisition device or adjacent devices, transferring the initial processing and analysis of the data to a place closer to the data generation site, reducing the need to transmit data to the central server. For batch data transmission, the data compression technology gzip is used to reduce the size of the data packet and increase the transmission speed.

[0033] When the data acquisition module collects data, it includes using sensors, data transmission interfaces and cameras to collect data; at the same time, the timestamp field is statistically added during the collection process to record the start time and end time of the instrument measurement; in order to ensure the accuracy of the timestamp, the clocks of the sending and receiving ends are synchronized through the NTP precise time protocol; the data acquisition module includes a sensor unit, a transmission interface docking unit, a camera unit and a time period recording unit;

[0034] The sensor unit performs distributed transmission and fusion statistics based on distributed collaboration algorithms and data fusion mechanisms to speed up data collection and calculation;

[0035] The transmission interface docking unit uses a standard communication interface for connection and communication between the instrument and the terminal;

[0036] The camera unit uses a camera to directly capture and collect data.

[0037] The data analysis module is used to clean, classify, verify, fuse and convert the data collected by the data acquisition module. The data analysis module analyzes the data. If the data is accurate, the collected data is stored in the data storage unit to form database data. If it is inaccurate, a correction is triggered, and the inaccurate collected data is required to be re-collected, which triggers the data acquisition unit to re-collect.

[0038] The data analysis module includes a data verification unit, a data fusion unit and a data conversion unit;

[0039] The data verification unit is used to verify the accuracy of the collected data in real time while collecting the data measured by the instrument in real time;

[0040] The data fusion unit uniformly divides and fuses the feature vector data according to the corresponding feature vectors, wherein the characteristics of the instrument itself include the instrument function and the instrument name;

[0041] In the data preprocessing stage, the data analysis module cleans, extracts features and standardizes the original data. Feature extraction is the key step. The data analysis module constructs feature vectors based on the characteristics of the instrument itself, and performs unified division, fusion and classification of feature vector data according to the corresponding feature vectors. At the same time, the data analysis module uses the digital-to-analog conversion unit to perform data conversion processing;

[0042] Feature selection: Use statistical tests (such as chi-square test, t-test, etc.) to select features that are significantly correlated with the target variable, and apply tree-based models (such as decision trees and random forests) to evaluate the importance of features; at the same time, extract the principal components in the data to reduce the dimension of the data while retaining most of the information. If the data has time series characteristics, the trend of data changes over time can be analyzed, such as using the ARIMA model for prediction.

[0043] The data storage unit is used to classify and store the data collected by the data collection module and the data processed by the data analysis module and to centrally store the final analysis data.

[0044] Reference Figure 1 The laboratory instrument data automatic collection and analysis platform is connected to a server and a terminal. The server is responsible for receiving, storing and managing the data collected from various laboratory instruments. At the same time, the server usually includes a user management function to ensure the access rights of different users to the data; the terminal device is usually connected to the laboratory instrument, responsible for real-time data collection and transmission to the server, and the terminal can provide a user interface for users to view real-time data, historical data and analysis results. Use network protocols (such as TCP / IP, MQTT, etc.) to realize data transmission between the terminal and the server to ensure data security and real-time performance.

[0045] The data analysis module is connected to the intelligent generation module. The intelligent generation module uses NLG technology to generate experimental statistics based on the data processed by the data analysis module. The experimental statistics include the type and quality of the substances. The experimental statistics generate the sentence: "The mass of experimental group A is X, and it is ground, melted or heated using device Y". By organically combining the data analysis module with the intelligent generation module, the laboratory can automate data processing, improve work efficiency, and reduce human errors. It not only optimizes the use of data, but also provides more convenient tools for researchers to help them better understand and use experimental results.

[0046] The intelligent generation module uses the received analysis results and predefined templates to fill the data into the relevant parts. For example, fill the cells of the experimental statistics table with analysis results or fill in the descriptive statistics in the text report through a fixed sentence structure and use variables to dynamically insert values. When it is necessary to convert to natural speech text, NLG technology is used to convert the data results into natural language text.

[0047] Assume that the data analysis results show that the experimental sample of a certain experimental group is X, the sample quality is Y, and the processing equipment is Z. The acquisition module receives this data, and then uses the data analysis module to analyze and process it. The intelligent generation module generates a fill-in report template and generates text similar to the following:

[0048] Title: Experimental Statistics Report

[0049] Experimental purpose: This experiment aims to record the experimental sample X's...

[0050] Result: Experimental sample X, mass Y, processed by instrument Z for h

[0051] Display chart: The generated chart shows the sample name, quality and processing time required

[0052] Output report: Finally generate a complete PDF report.

[0053] The generation module can effectively realize the automatic generation of experimental statistics tables and text reports, thereby improving laboratory work efficiency.

[0054] The data storage unit includes a single storage unit, a fusion storage unit and a central collection storage unit, wherein the single storage unit is used to store data information of each stage collected by the data collection unit;

[0055] The fusion storage unit is used to store the data information processed by the data analysis module, and the central collection storage unit is used to store the collection data information of the experimental statistical table generated by the intelligent generation module.

[0056] Specific, including some process examples

[0057] Data collection: The instrument collects a certain measurement data (such as temperature) in real time, such as "25.6°C";

[0058] Real-time verification: The data verification unit performs the following verification on the collected data:

[0059] Range check: check whether 25.6℃ is within the predetermined reasonable range (e.g. 0℃ to 100℃); logic check: if the last acquisition was "25.5℃", whether it is within the reasonable range of variation (e.g. ±1℃);

[0060] Results feedback:

[0061] If the data is qualified: the data is transferred to the database and recorded as "qualified"; if the data is unqualified: the data is recorded as "abnormal", an alarm is generated, the operator is notified, and the operator can choose to discard or use interpolation to correct it;

[0062] Log records: All verification and feedback results will be recorded in log files to facilitate subsequent data quality review. The data verification unit can effectively improve the accuracy and reliability of laboratory automated data collection and provide strong data support for scientific research.

[0063] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents. These modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention, and they should all be included in the scope of the claims and specification of the present invention.

Claims

1. A laboratory instrument data automatic acquisition and analysis platform, characterized in that: Specifically includes the following modules: A data acquisition module is used to collect data measured by the instrument in real time by performing data acquisition on the instrument; When the data acquisition module collects data, it uses sensors, data transmission interfaces and cameras to collect data. At the same time, the timestamp field is added to the statistics during the collection process to record the start and end time of the instrument measurement. In order to ensure the accuracy of the timestamp, the clocks of the sender and receiver are synchronized through the NTP precise time protocol. The data analysis module is used to clean, classify, verify, fuse and convert the data collected by the data collection module; In the data preprocessing stage, the data analysis module cleans, extracts features and standardizes the original data. Feature extraction is the key step. The data analysis module constructs feature vectors based on the characteristics of the instrument itself, and performs unified division, fusion and classification of feature vector data according to the corresponding feature vectors. At the same time, the data analysis module uses the digital-to-analog conversion unit to perform data conversion processing; The data storage unit is used to classify and store the data collected by the data collection module and the data processed by the data analysis module and to centrally store the final analysis data.

2. The laboratory instrument data automatic acquisition and analysis platform according to claim 1, characterized in that: The laboratory instrument data automatic collection and analysis platform is connected to a server and a terminal. The server is responsible for receiving, storing and managing data collected from various laboratory instruments. At the same time, the server usually includes a user management function to ensure different users have access rights to the data. The terminal device is usually connected to the laboratory instrument and is responsible for real-time data collection and transmission to the server. The terminal can provide a user interface to facilitate users to view real-time data, historical data and analysis results.

3. The laboratory instrument data automatic acquisition and analysis platform according to claim 1, characterized in that: The data analysis module is connected to an intelligent generation module, which generates an experimental statistical table using NLG technology based on the data processed by the data analysis module. The experimental statistical table focuses on indicators such as material type and quality. The experimental statistical table generates a sentence: "The mass of experimental group A is X, and Y equipment is used for grinding, melting or heating treatment." 4. The laboratory instrument data automatic acquisition and analysis platform according to claim 1, characterized in that: The data acquisition module includes a sensor unit, a transmission interface docking unit, a camera unit and a time period recording unit; The sensor unit performs distributed transmission and fusion statistics based on distributed collaboration algorithms and data fusion mechanisms to speed up data collection and calculation; The transmission interface docking unit uses a standard communication interface for connection and communication between the instrument and the terminal; The camera unit uses a camera to directly capture and collect data.

5. The laboratory instrument data automatic acquisition and analysis platform according to claim 1, characterized in that: The data analysis module includes a data verification unit, a data fusion unit and a data conversion unit; The data verification unit is used to verify the accuracy of the collected data in real time while collecting the data measured by the instrument in real time; The data fusion unit uniformly divides and fuses the feature vector data according to the corresponding feature vectors, wherein the characteristics of the instrument itself include the instrument function and the instrument name.

6. The laboratory instrument data automatic acquisition and analysis platform according to claim 1, characterized in that: The data storage unit includes a single storage unit, a fusion storage unit and a central collection storage unit, wherein the single storage unit is used to store data information of each stage collected by the data collection unit; The fusion storage unit is used to store the data information processed by the data analysis module, and the central collection storage unit is used to store the collection data information of the experimental statistical table generated by the intelligent generation module.

Images