Relevant database for managing heterogeneous unstructured data and method for creating and inquiring description information of unstructured data thereof

Abstract

The invention provides a relevant database for managing heterogeneous unstructured data; and the database comprises formatted text which is used for describing the unstructured data which is stored outside the database. The formatted text comprises a uniform resources identifier (URI) character string which provides the access protocol and storage position of the data, a data validation attribute field and a data format field. Meanwhile, the invention also provides a creation method and an inquiry method for managing the relevant database for managing the external heterogeneous data. The relevant database for managing heterogeneous unstructured data and the method for creating and inquiring the description information of the unstructured data thereof have the beneficial effects that the external data management mechanism of the database has high extendability and can adapt to various access protocols of the external data, and meanwhile the completeness of the external data management of the database and the data independency of external data orientation are improved.

Description

technical field [0001] The invention belongs to the field of data storage, and in particular relates to a relational database for managing external heterogeneous data and methods for creating and querying. Background technique [0002] "Big data" (Big data), in short, is the ability to quickly obtain information from a variety of massive data, which is big data technology. Big data is usually used to describe a large number of unstructured data created by a company. and semi-structured data that would take too much time and money to download to a relational database for analysis. Big data analysis is often associated with cloud computing because real-time analysis of large data sets requires a framework like MapReduce to distribute work among tens, hundreds, or even thousands of computers. [0003] BLOB, TEXT and other fields are often used in existing relational databases, which cannot meet the support for big data. Both relational databases ORACLE and MS SQL Server have B...

AI Technical Summary

Problems solved by technology

[0003] BLOB, TEXT and other fields are often used in existing relational databases, which cannot meet the support for big data. Both relational databases ORACLE and MS SQL Server have BLOB type fields stored outside the database. In ORACEL, it is BFILE, MS SQL Server It is FileStream, which are characterized by the file name of the data stored in the database, and the database reads the data stored on the disk through the file name

The disadvantage is that the integrity of the data and the consistency with other fields of the database must be guaranteed through external applications, and the database itself has no corresponding binding capabilities

At the same time, the protocol supported by external storage is single, unable to support a variety of remote storage, and adapt to various distributed storage protocols emerging in an endless stream

Images