Combined application method of distributed file storage system and relation database

Abstract

The invention discloses a combined application method of a distributed file storage system and a relation database. The method comprises the following steps of: 1) classifying data to be written into the database into high-instantaneity data and low-instantaneity data; 2) inputting the high-instantaneity data into the relation database; 3) inputting the low-instantaneity data into the distributedfile system for subsequent data processing; and 4) inputting a result of the subsequent data processing into the relation database. Through the method, good user experience can be brought and strong basic guarantee is provided for subsequent data processing; due to data classification, a good data structure and a good relation are achieved; during subsequent processing work, real-time inquiry work is stripped and data extraction effect is enhanced directly; and the pressure on the current relation database is relieved and data analysis is more perfect.

Description

technical field [0001] The invention relates to the field of data mining, in particular to a combined application method of a distributed file storage system and a relational database (RDBMS). Background technique [0002] The current relational database application is divided into two ways: [0003] Real-time query of data, timely response to user requests, and timely feedback on data analysis. [0004] Data mining is carried out on the basis of existing data, that is, analyzing historical data to extract useful data result sets. [0005] The application modes of the above two databases have advantages in reading and writing data when the amount of data is not large. However, after the data grows by an order of magnitude, frequent data entry and frequent reading will directly lead to bottlenecks in I / O (input / output interface) operations and low data query efficiency. Because all data is entered and read in real time, and some routine data mining work is also in progress...

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a technical solution to solve the problem of reduced query speed caused by frequent entry and reading of relational databases. The applicant of the present invention has learned through analysis that part of the data content does not require real-time feedback results, but rather It is data that needs further mining and analysis; but some data does require real-time result feedback

Therefore, the technical solution of the present invention—the combined application method of the distributed file storage system and the relational database solves the problem of low query efficiency caused by the I / O bottleneck in the application of the relational database

Images