Method and device for data management

Abstract

A data management method and device. The method includes: dividing a magnetic disk into a plurality of storage pools logically, with the blocks in the same storage pool being equal in size; providing an ingress index array in the memory which indicates information about each storage pool; grouping the Key in a key value pair Key-Value, the pool index of the storage pool divided in the magnetic disk, and the block index of the block in the storage pool into a triple and storing same into the memory; locating the storage location of a certain data record in the magnetic disk according to the ingress index array provided and the triple information stored in the memory and performing read, write or delete operation of the data according to the storage location. The technical solution can effectively manage massive data without disk defragmentation, so that the utilization rate of the magnetic disk can be improved significantly and the speed of indexing and reading K-V can be improved greatly, thus providing highly efficient data storage and management operations.

Description

Technical field [0001] The present invention relates to the technical field of data management, in particular to a method and device for data management. Background technique [0002] At present, with the development of computer technology and network technology, the amount of data information has increased exponentially, and human data has reached an unprecedented scale. The storage and management of these ultra-large-scale data has become a major challenge in the industry. Traditional relational databases cannot provide efficient disk read and write operations when managing such ultra-large-scale data, and cannot meet good scalability and high availability. In this context, the emergence of various non-relational databases, especially the K-V (Key-Value) database StoreDB, has solved the above problems. [0003] In the prior art, Key-Value storage has become a common storage method in the industry, and it is used in more and more places, especially in cloud storage; some of these...

AI Technical Summary

Problems solved by technology

[0003] In the existing technology, Key-Value storage has become a common storage method in the industry, and it is applied in more and more places, especially in cloud storage; some of these storage engines are in Appendonly mode, and some are directly modifiable modes , and these technical solutions all involve data compression or defragmentation in the background, all of which require irregular global data movement to improve disk utilization, and in the process of such compression or defragmentation, the performance of the database will be greatly affected. Large impact, unable to provide efficient disk read and write operations

Images