A system and method supporting rapid storage and retrieval of large-scale authentication data

Abstract

The invention discloses a system and method for supporting rapid storage and retrieval of large-scale authentication data. The system includes an authentication data storage and retrieval system and an authentication system; the authentication data storage and retrieval system establishes a network between the authentication system and the authentication system through a light data access protocol. connection; the front end of the authentication data storage and retrieval system receives and processes the authentication data access request of the authentication system in parallel; the back end of the authentication data storage and retrieval system adopts the key-value pair authentication data combining hash and internal partition technology to land Storage; between the front-end and back-end of the authentication data storage and retrieval system, provide a hot data key-value pair authentication data memory caching mechanism suitable for the stored authentication data. The present invention integrates multiple technical advantages, and provides a solution for fast storage and retrieval of large-scale authentication data by using a single system.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a system and method for supporting fast storage and retrieval of large-scale authentication data. Background technique [0002] With the rapid development of Internet technology, the real society extends deeply into the cyberspace, and the network society has become an important part of the real society. While the Internet has brought earth-shaking changes to people's lives, it has also significantly changed people's behavior. Behaviors and businesses that used to only happen in the real world, such as sending and receiving emails, socializing, shopping, and bank transactions, quickly appeared in cyberspace and developed rapidly. . In many fields, traditional identity management methods are no longer applicable in cyberspace. The new identity authentication management adopts real-name or identity based on certificate data including network mapping certificate signature d...

AI Technical Summary

Problems solved by technology

[0005] However, the directory service system has application specificity and limitations. For example, it requires data to have a tree-shaped organizational structure, which is naturally applied to systems with tree-shaped data organization relationships such as library book indexing systems and organizational personnel management systems; Emphasizes the speed of retrieval, and establishes indexes such as equality, substring, and existence, but sacrifices storage efficiency. As the data increases, the storage speed becomes lower and lower; the internal data storage form of the system generally uses B+ trees structure, which makes it possible to obtain superior retrieval performance under a small amount of data, but when the amount of data reaches hundreds of millions, the level of the B+ tree structure will be divided into too many layers, and the retrieval performance will be greatly reduced, especially in order to maintain the B+ tree structure The increase of new data may also cause the rebalancing of the entire B+ tree structure, and the storage performance will also drop significantly

Images