Mass data joint storage method and retrieval method based on unified index

Abstract

The invention provides a mass data united storage method based on a unified indexing and a search method. The storage method comprised the following steps: reading data to be stored and judging a data type of the data to be stored, wherein the data type comprises a non-relation type and a relation type ; if the data to be stored is the non-relation type data, storing the non-relation type data to storage equipment and adding data information of the non-relation type data into a pre-established data unified indexing; and if the data to be stored is the relation type data, storing the relation type data to the storage equipment and adding data information of the relation type data into the pre-established data unified indexing. According to the mass data united storage method disclosed by the invention, the unification of each data logic storage structure and the transparency of a physical storage structure are guaranteed; and the general expansibility, the operation efficiency and the stability of an application system are improved.

Description

technical field [0001] The invention belongs to the technical field of data storage, and in particular relates to a unified index-based massive data joint storage method and retrieval method. Background technique [0002] With the continuous development of the information age, the information interaction between different departments and different regions is gradually increasing. Through data exchange and sharing, more people can make full use of existing data resources and reduce duplication of data collection and data acquisition. and corresponding fees. [0003] However, under the trend of comprehensive informatization of enterprises and gradual refinement of application system functions, the data generated by application systems is often large-scale, multi-type and disorderly. The basis for defining different types of data in various existing businesses is basically through " "Business-driven" is defined and processed within the application system that generates the cor...

AI Technical Summary

Problems solved by technology

[0003] However, under the trend of comprehensive informatization of enterprises and gradual refinement of application system functions, the data generated by application systems is often large-scale, multi-type and disorderly. The basis for defining different types of data in various existing businesses is basically through " "Business-driven" is defined and processed within the application system that generates the corresponding data. Due to the differences in data types and data structures, it is difficult to realize data exchange and data sharing between different application systems, and sometimes even encounter data formats that cannot be converted or The thorny problem of losing information after data conversion format seriously hinders the exchange and sharing of data in various application systems

Due to the inconsistency of data storage structure and logical structure, the process of processing and organizing various types of data is very complicated and difficult.

[0004] The traditional data interaction between application systems is based on the public interface negotiated by the two systems. This type of method mainly has the following problems: (1) In order to share data in a certain data format, each application system needs to configure dedicated data Shared interface, resulting in low scalability of each application system; especially in the case of sharing data between multiple application systems and a large amount of shared data, greatly increasing the complexity and coupling of each application system; (2) Frequent data exchange between various application systems will reduce the operating efficiency of the application system; (3) Due to the heterogeneity of data, the data exchanged between application systems is often not directly available and needs to be cached in an intermediate database, thus wasting storage space

Therefore, data interaction between existing application systems will directly affect the general scalability, operating efficiency and stability of the application systems

Images