A file storage system and method

Abstract

The present invention particularly relates to a file storage system and method. The file storage system includes six parts: data file detection subsystem, data file measurement subsystem, data file rule verification subsystem, data file processing and conversion subsystem, storage script generation subsystem and storage execution subsystem. The system and method for document warehousing converts various tasks that require manual manual warehousing before, during and after warehousing of data text files into a computer automatic warehousing implementation device, and simultaneously solves the problem of data jumping out during data warehousing , data storage garbled and other data quality problems, to ensure the high-quality automatic storage of data files.

Description

technical field [0001] The invention relates to the field of text file processing technology and database technology, in particular to a file storage system and method. Background technique [0002] Data text file is a common data format, and it is a very common data format in the process of data migration, data exchange, and data ETL. At the same time, it is also a very task to store this common data file in high quality. [0003] Although there are some common data loading tasks in many database tools, the measurement, understanding and processing and conversion of the data files themselves need to be implemented manually, so it is inevitable that there will be some data jumping out and some data when the data is stored in the database. Various quality problems such as garbled characters after data storage. In addition, in the process of measuring and understanding data files, due to human subjectivity, the measurement dimensions, file structures and processing methods of...

AI Technical Summary

Problems solved by technology

[0003] Although there are already some common data loading tasks in many database tools, the measurement, understanding, processing and conversion of the data files themselves all need to be implemented manually, so it is inevitable that some data will jump out and some Various quality problems such as garbled characters after data storage

In addition, due to human subjectivity in the process of measuring and understanding data files, the measurement dimensions, file structures, and processing methods of data files are inconsistent, resulting in no unified measurement and processing specifications and standards for data files, resulting in data files entering The database not only consumes a lot of manpower, but also cannot guarantee the high quality of the data after entering the database, and a large number of repetitive tasks are generated.

Images