Device and method for discovering column correlativity of self-adaptive data structure

Abstract

The invention discloses a column correlation discovering device and method of a self-adaptive data structure, belongs to the technical field of data processing, and solves the problems that in the prior art, new data processing is slow, and data analysis depends on the scope of knowledge, experience and calendar reading of a data user, so that analysis is inaccurate. Comprising a data acquisition device used for acquiring data and a reference sample library used for storage, the data acquisition device is connected with a data processor used for performing field analysis on the data, and the data processor is connected with a format correction device used for processing and correcting the data. The format correction device is connected with a data analysis device used for carrying out index and data calculation on the collected data, and the data analysis device is connected with a data transmitter used for transmitting the data. According to the method, persistent storage space does not need to be occupied, waste of the storage space is reduced, relational data in various analyzable forms can be compatible, and omission of variable correlation caused by knowledge limitation can be avoided.

Description

technical field [0001] The invention belongs to the technical field of data processing, in particular to a device and method for discovering column correlations of an adaptive data structure. Background technique [0002] Traditional data usage, processing, and analysis solutions are usually BI tools. BI tools complete query and screening of data through simple drag and drop methods, and visualize the data that data users need to use. However, before using this solution, It is necessary to clarify the file name, field name, field type, field length, number of data rows and columns and other data structures of the data used, and use corresponding data analysis methods and data analysis tools according to different data structures. This solution can only solve query problems, screening problems, and visual display problems for this kind of relational data processing, but cannot solve the difficult problem of data analysis. This tool has the following disadvantages for the pro...

AI Technical Summary

Problems solved by technology

[0005] Aiming at the problems in the prior art that the processing of new data is slow and data analysis relies on the knowledge, experience and experience of the data user, resulting in inaccurate analysis, the present invention provides an adaptive data structure column correlation discovery device and method , its purpose is: to solve the need to clarify the data structure in advance to perform subsequent calculations; once the field is resolved, the field type, attribute and content cannot be readjusted, modified and processed. If you need to modify and process the entire data processing and calculation process, you need to start from The first step is the start of data analysis; experimenters and developers often only pay attention to the causal relationship between indicators they know, and other correlations that are easily overlooked or undetected may be ignored by knowledge limitations; when calculating data correlation Efficiency will be affected by the amount of data and the number of sequences

Images