An intelligent analysis system for digital experimental data
By introducing data classification, checksum format conversion modules into the intelligent analysis system, the problem of unreasonable data storage is solved, the accuracy and security of data are improved, and the data storage and reading efficiency is optimized.
Patent Information
- Application Number
- CN202410796291.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-19
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2044-06-19
AI Technical Summary
When existing intelligent analysis systems process large amounts of experimental data, they cannot perform reasonable storage analysis based on the data's own characteristics, resulting in low data extraction efficiency and unsafe storage.
An intelligent analysis system for digital experimental data was designed, including a data classification processing module, a data intelligent analysis module and an intelligent storage analysis module. By checking and correcting the error data, the data is converted in format and divided into storage space, and the storage is generated. Information to improve the accuracy and security of data utilization.
It improves the accuracy and storage security of the subsequent utilization of data, and optimizes the stored procedures through data classification and format conversion, which facilitates data reading and management.
Smart Images

Figure CN118586599B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data intelligent analysis, and in particular to an intelligent analysis system for digitalized experimental data. Background Art
[0002] The intelligent analysis system for digital experimental data is a comprehensive platform that integrates multiple technologies and functions, aiming to improve laboratory work efficiency, data management security and analysis accuracy.
[0003] According to Chinese patent application number CN201910567212.0, an experiment management and data analysis system is disclosed, which includes: an experiment data management module, configured to obtain original experiment data and perform data management on the original experiment data to generate standardized experiment data; a data analysis module, configured to select a corresponding algorithm to analyze the standardized experiment data according to the experimental requirements; a report generation module, configured to generate a data analysis report corresponding to the analysis results of the standardized experiment data; an experiment management module, configured to take the entire life cycle of the experiment as the main line, and uniformly manage the experiment data management module, the data analysis module and the report generation module.
[0004] The above patent integrates a series of businesses such as experimental resource management, experimental preparation, experimental data collection, experimental data standardization, experimental data management, multi-dimensional complex experimental data analysis, automated reporting, data visualization, comparative analysis of experimental data and design, simulation, and operation data, and deploys all data and businesses of the entire experimental life cycle to the network cloud. All users' business interfaces are accessed through the browser, which minimizes personal computer performance requirements and greatly improves the efficiency of various businesses.
[0005] However, when some existing intelligent analysis systems analyze data, due to the large amount and variety of experimental data, the operators' independent management is inefficient and there will be improper management. In addition, for data storage, reasonable storage analysis cannot be performed based on the characteristics of the data itself, which further affects the subsequent data extraction. Summary of the invention
[0006] In view of the shortcomings of the prior art, the present invention provides an intelligent analysis system for digital experimental data, which solves the problem that reasonable storage and analysis cannot be performed according to the characteristics of the data itself, which affects the subsequent data extraction.
[0007] To achieve the above objectives, the present invention is implemented through the following technical solutions: an intelligent analysis system for digital experimental data, comprising:
[0008] A digital experiment data acquisition module is used to transmit the acquired experiment data to the data classification processing module;
[0009] The data classification processing module is used to classify the acquired experimental data to obtain correct data and erroneous data, and to verify the erroneous data to obtain correct data, and transmit the correct data to the data intelligent analysis module;
[0010] The data intelligent analysis module is used to convert the format of the acquired correct data, and determine whether to convert the format by considering the data integrity and data impact, and generate format conversion data and non-format conversion data at the same time, and then transmit the two to the intelligent storage analysis module;
[0011] The intelligent storage analysis module is used to store the acquired format conversion data and non-format conversion data. For the format conversion data, the storage space is divided and the storage information is generated by storing the format conversion data in combination with the data capacity. For the non-format conversion data, the storage information is generated by sorting the data capacity and the storage information is transmitted to the analysis result output module.
[0012] The analysis result output module is used to store the acquired storage information.
[0013] As a further solution of the present invention: the data classification processing module classifies the experimental data and checks the erroneous data in the following specific manner:
[0014] Obtain all experimental data, and classify the experimental data into correct data and incorrect data, and label the correct data as a, where a=1, 2, ..., n, and label the incorrect data as b, where b=1, 2, ..., m, where n and m are both positive integers;
[0015] Then, all the erroneous data b are obtained, and it is determined whether the erroneous data b is a measurement error or an error itself. For the erroneous data caused by the measurement error, the erroneous data b is measured multiple times to obtain re-measured data, and the deviation values of the multiple re-measured data are calculated. The erroneous data b is further calibrated according to the deviation values to obtain the correct data;
[0016] For erroneous data caused by errors itself, the current environment in which the erroneous data is obtained is compared, and the current collection environment is adjusted. At the same time, data is collected according to the adjusted environment to obtain correct data.
[0017] As a further solution of the present invention: the specific method of the data intelligent analysis module to judge the format conversion of the correct data is:
[0018] Obtain all correct data and the data formats corresponding to the correct data, and record the data formats as A, B, ..., Z. Then obtain the number of correct data corresponding to different data formats, and select the data format corresponding to the largest number of correct data as the standard format;
[0019] Then convert the correct data in different data formats into the standard format. When converting to the standard format, determine whether there is missing data. If there is no missing data, directly perform the format conversion. Otherwise, if there is missing data, obtain the corresponding missing data and determine the impact of the missing data on the overall data.
[0020] As a further solution of the present invention: the specific method of determining the impact of missing data on the overall data is:
[0021] When the missing data has no impact on the overall situation, the format conversion is performed directly. Conversely, when the missing data has an impact on the overall situation, the format conversion is canceled and the original data format is retained. This process is analogous to obtaining format-converted data and non-format-converted data.
[0022] As a further solution of the present invention: the specific way in which the intelligent storage analysis module divides the storage space is:
[0023] The storage space is divided into a format conversion storage space and a non-format conversion storage space, and the format conversion storage space is divided at the same time. The specific division method is: the format conversion storage space is divided into multiple groups of concentric circles, and the interval between each two groups of concentric circles is the same, and the formed storage intervals are numbered from the outside to the inside as 1, 2, ..., y, and y is a positive integer.
[0024] As a further solution of the present invention: the specific manner in which the intelligent storage analysis stores the format conversion data is:
[0025] Obtain all format conversion data and record them as i, where i=1, 2, ..., k, and k is a positive integer, extract and remove duplicate data in the format conversion data i, and store the format conversion data i in the format conversion storage space;
[0026] The format conversion data i is classified into the same type according to the data type, and the number of different types of data pairs is obtained at the same time, and they are stored from the outside to the inside in order from large to small. When storing in the storage interval, the data capacity of the same type of data is obtained to determine the parity of the data capacity. When the data capacity is an odd number, the same type of data is stored clockwise. Conversely, when the data capacity is an even number, the same type of data is stored counterclockwise to generate storage information.
[0027] As a further solution of the present invention: the storage method of the non-format conversion data by the intelligent storage and analysis module is:
[0028] All the non-format conversion data o are obtained, and at the same time, the data capacity Ro corresponding to the non-format conversion data o is obtained, and the data capacity Ro is sorted from large to small, and the data is stored in sequence to generate storage information.
[0029] The present invention provides an intelligent analysis system for digital experimental data. Compared with the prior art, it has the following beneficial effects:
[0030] The present invention classifies the collected experimental data, corrects the data by analyzing the data collection environment for the collected erroneous data, thereby improving the accuracy of subsequent data utilization. At the same time, when storing the data, the data format is analyzed and the data is converted into a unified format. For data that can be converted in format, the storage space is divided in combination with the capacity of the data itself, and the data storage process is further encrypted. The data is stored accordingly to generate storage information, thereby improving the security of data storage. For data that cannot be converted in format, storage information is generated according to the data capacity. Based on the above analysis, the data is reasonably stored, which is convenient for subsequent reading of the data and improves the accuracy of data utilization. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Figure 1 This is a block diagram of the system principle of the present invention;
[0032] Figure 2 This is a schematic diagram of the storage space division of the present invention. DETAILED DESCRIPTION
[0033] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0034] See also Figure 1 The present application provides an intelligent analysis system for digital experimental data, including a digital experimental data acquisition module, a data classification processing module, a data intelligent analysis module, an intelligent storage and analysis module, and an analysis result output module.
[0035] Digital experiment data acquisition module, this function module is used to collect experimental data and transmit the experimental data to the data classification processing module.
[0036] Data classification processing module: This function module is used to classify the acquired experimental data to obtain correct data and erroneous data, and to verify the erroneous data to obtain correct data. The specific analysis method is as follows:
[0037] Obtain all experimental data, and classify the experimental data into correct data and incorrect data, and label the correct data as a, where a=1, 2, ..., n, and label the incorrect data as b, where b=1, 2, ..., m, where n and m are both integers;
[0038] First, ensure that all data generated during the experiment are collected. This includes aggregating data from all relevant experimental equipment, software, and records. Perform a preliminary inspection of the collected data to identify obvious anomalies or data points that deviate from expected values in preparation for in-depth analysis.
[0039] Carefully analyze the experimental data and classify the data that meets the experimental requirements and the expected model as correct data. Number these correct data points and mark them as a, where the values of a are 1, 2, ..., n, where n represents the total number of correct data.
[0040] Similarly, data points that do not meet expectations or have obvious problems are classified as erroneous data. These erroneous data are similarly numbered and labeled as b, where the value of b is 1, 2, ..., m, and m represents the total number of erroneous data.
[0041] Then, all the erroneous data b are obtained, and it is determined whether the erroneous data b is a measurement error or an inherent error. The measurement error here refers to the erroneous data caused by measurement errors when the data is obtained, and the inherent error refers to the erroneous data caused by the acquisition environment. For the erroneous data caused by the measurement error, the erroneous data b is measured multiple times to obtain re-measured data, and the deviation values of the multiple re-measured data are calculated. The erroneous data b is further calibrated according to the deviation values to obtain correct data.
[0042] For erroneous data caused by errors itself, the current environment in which the erroneous data is obtained is compared, and the current collection environment is adjusted. At the same time, data is collected according to the adjusted environment to obtain correct data.
[0043] Finally, the correct data is transmitted to the data intelligent analysis module.
[0044] Data intelligent analysis module: This function module is used to analyze the format of the acquired correct data, and the specific analysis method is as follows:
[0045] Obtain all correct data and the data formats corresponding to the correct data, and record the data formats as A, B, ..., Z. Then obtain the number of correct data corresponding to different data formats, and select the data format corresponding to the largest number of correct data as the standard format;
[0046] Then, the correct data in different data formats are converted into standard formats. When converting to the standard format, it is determined whether there is data missing. If there is no data missing, the format conversion is performed directly. Otherwise, if there is data missing, the corresponding missing data is obtained and the impact of the missing data on the overall data is determined.
[0047] When the missing data has no overall impact, the format conversion is performed directly. Otherwise, when the missing data has an overall impact, the format conversion is canceled and the original data format is retained.
[0048] After format conversion analysis is performed on all correct data, format conversion data and non-format conversion data are obtained, and both are transmitted to the intelligent storage analysis module.
[0049] In the process of data standardization, the next key step is to convert the correct data in different data formats into the previously determined standard format. During this conversion process, the first task is to check the data integrity to ensure the data quality and accuracy of processing. Specifically, it is necessary to determine whether there is any missing data before the format conversion.
[0050] If the check results show that the data is intact, format conversion can be performed directly. This step converts data in different formats into a unified standard format through software tools or manual methods to ensure the consistency and comparability of all data in subsequent analysis.
[0051] However, if there are missing data, further steps are required. First, the specific missing data needs to be identified and obtained. Then, the impact of the missing data on the overall data set must be evaluated. If the missing data is not considered to have a significant impact on the overall results after analysis, the format conversion can be continued. In this case, the missing data can be appropriately filled or ignored without seriously affecting the accuracy of the data analysis.
[0052] On the contrary, if missing data may have a significant impact on the research results, it should be handled with caution. In this case, it is recommended to cancel the format conversion and retain the original format of the data. This is to avoid information loss that may be caused by data conversion and ensure the integrity of the research and the authenticity of the data.
[0053] Intelligent storage analysis module, this function module is used to store and analyze the acquired format conversion data and non-format conversion data to obtain storage information, and the specific method of performing storage analysis is as follows:
[0054] All format conversion data are obtained and recorded as i, where i=1, 2, ..., k, and non-format conversion data are recorded as o, where o=1, 2, ..., p, and k and p are both integers. Then, duplicate data in the two are extracted and removed, and the storage space is divided into format conversion storage space and non-format conversion storage space, as shown in the attached figure. Figure 2 As shown;
[0055] Obtain format conversion data i with duplicate data removed, and store the format conversion data i in the format conversion storage space, and encrypt the format conversion data i during storage, and the specific encryption storage method is: obtain the data capacity of the format conversion data i and record it as Ri, and sort it from small to large according to the data capacity Ri, then divide the format conversion storage space into multiple groups of concentric circles, and the intervals between every two groups of concentric circles are the same, and the formed storage intervals are numbered from outside to inside as 1, 2, ..., y, and y is an integer;
[0056] First, determine the data capacity of the format conversion data i, denoted as Ri. Then, in order to manage the storage process more effectively, all data need to be sorted according to the size of their data capacity Ri. Sorting is performed from the smallest to the largest data capacity, which helps with subsequent storage optimization.
[0057] Then, prepare the format conversion storage space, which will be used to store our data safely. In order to improve storage efficiency and cooperate with encryption strategy, this storage space is divided into multiple groups of concentric circles. The interval between each two adjacent concentric circles is set to the same distance, which is intended to balance the storage load and optimize the access speed of data. For these formed concentric circle intervals, they are numbered in sequence from the outer circle to the inner circle, with the numbers 1, 2, ..., y, where y is an integer representing the total number of intervals.
[0058] The format conversion data i is classified into the same type of data according to the data type, and the number of different types of data pairs is obtained at the same time, and stored from the outside to the inside in order from large to small. When storing in the storage interval, the data capacity of the same type of data is obtained to determine the parity of the data capacity. When the data capacity is an odd number, the same type of data is stored clockwise. Conversely, when the data capacity is an even number, the same type of data is stored counterclockwise to further generate storage information.
[0059] First, the format-converted data is classified according to its data type. Then, the number of each data type is counted, and when it is stored in the pre-set concentric circle intervals, the specific storage direction of the data is determined according to the parity of the data capacity. For data with an odd data capacity, it is stored in a clockwise direction; for data with an even data capacity, it is stored in a counterclockwise direction. This strategy aims to improve data retrieval efficiency while maintaining a balanced storage load.
[0060] After the data classification and storage plan are determined, the data capacity of each type is obtained and judged. According to the parity of the data capacity, the data is stored in the specified storage interval according to the above strategy. After the data storage process is completed, the system will generate the corresponding storage information.
[0061] The storage method for non-format conversion data is: obtain all non-format conversion data o, and obtain the data capacity Ro corresponding to the non-format conversion data o, and sort them from large to small according to the data capacity Ro, and store them in order to generate storage information.
[0062] The generated storage information is then transmitted to the analysis result output module.
[0063] Analysis result output module: This functional module is used to obtain the stored information and then decrypt the data according to the stored information.
[0064] Some of the data in the above formulas are dimensionless and numerically calculated. Meanwhile, the contents not described in detail in this specification belong to the prior art known to those skilled in the art.
[0065] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present invention.
Claims
1. An intelligent analysis system for digital experimental data, characterized in that: include: The data classification processing module is used to classify the acquired experimental data to obtain correct data and erroneous data, and to verify the erroneous data to obtain correct data, and transmit the correct data to the data intelligent analysis module; The data intelligent analysis module is used to convert the format of the acquired correct data, and determine whether to convert the format by considering the data integrity and data impact, and generate format conversion data and non-format conversion data at the same time, and then transmit the two to the intelligent storage analysis module; The intelligent storage analysis module is used to store the acquired format conversion data and non-format conversion data. For the format conversion data, the storage space is divided and the storage information is generated by storing the format conversion data in combination with the data capacity. For the non-format conversion data, the storage information is generated by sorting the data capacity and the storage information is transmitted to the analysis result output module. The specific method of dividing the storage space is as follows: The storage space is divided into a format conversion storage space and a non-format conversion storage space, and the format conversion storage space is divided at the same time. The specific division method is: the format conversion storage space is divided into multiple groups of concentric circles, and the interval between each two groups of concentric circles is the same, and the formed storage intervals are numbered from the outside to the inside as 1, 2, ..., y, and y is a positive integer.
2. The intelligent analysis system for digital experimental data according to claim 1, characterized in that: It also includes a digital experiment data acquisition module and an analysis result output module; A digital experiment data acquisition module is used to transmit the acquired experiment data to the data classification processing module; The analysis result output module is used to store the acquired storage information.
3. The intelligent analysis system for digital experimental data according to claim 1, characterized in that: The data classification processing module classifies the experimental data and checks the erroneous data in the following specific manner: Obtain all experimental data, and classify the experimental data into correct data and incorrect data, and label the correct data as a, where a=1, 2, ..., n, and label the incorrect data as b, where b=1, 2, ..., m, where n and m are both positive integers; Then, all the erroneous data b are obtained, and it is determined whether the erroneous data b is a measurement error or an error itself. For the erroneous data caused by the measurement error, the erroneous data b is measured multiple times to obtain re-measured data, and the deviation values of the multiple re-measured data are calculated. The erroneous data b is further calibrated according to the deviation values to obtain the correct data; For erroneous data caused by errors itself, the current environment in which the erroneous data is obtained is compared, and the current collection environment is adjusted. At the same time, data is collected according to the adjusted environment to obtain correct data.
4. The intelligent analysis system for digital experimental data according to claim 1, characterized in that: The specific method of the data intelligent analysis module to judge the format conversion of the correct data is: Obtain all correct data and the data formats corresponding to the correct data, and record the data formats as A, B, ..., Z. Then obtain the number of correct data corresponding to different data formats, and select the data format corresponding to the largest number of correct data as the standard format; Then convert the correct data in different data formats into the standard format. When converting to the standard format, determine whether there is missing data. If there is no missing data, directly perform the format conversion. Otherwise, if there is missing data, obtain the corresponding missing data and determine the impact of the missing data on the overall data.
5. The intelligent analysis system for digital experimental data according to claim 4, characterized in that: The specific way to determine the impact of missing data on the overall data is: When the missing data has no impact on the overall situation, the format conversion is performed directly. Conversely, when the missing data has an impact on the overall situation, the format conversion is canceled and the original data format is retained. This process is analogous to obtaining format-converted data and non-format-converted data.
6. The intelligent analysis system for digital experimental data according to claim 1, characterized in that: The specific way in which the intelligent storage and analysis module stores the format conversion data is as follows: Obtain all format conversion data and record them as i, where i=1, 2, ..., k, and k is a positive integer, extract and remove duplicate data in the format conversion data i, and store the format conversion data i in the format conversion storage space; The format conversion data i is classified into the same type according to the data type, and the number of different types of data pairs is obtained at the same time, and stored from the outside to the inside in order from large to small. When storing in the storage interval, the data capacity of the same type of data is obtained to determine the parity of the data capacity. When the data capacity is an odd number, the same type of data is stored clockwise. Conversely, when the data capacity is an even number, the same type of data is stored counterclockwise to generate storage information.
7. The intelligent analysis system for digital experimental data according to claim 1, characterized in that: The storage method of the intelligent storage and analysis module for the non-format conversion data is as follows: All the non-format conversion data o are obtained, and at the same time, the data capacity Ro corresponding to the non-format conversion data o is obtained, and the data capacity Ro is sorted from large to small, and the data is stored in sequence to generate storage information.
