Hash table processing method

A processing method and hash table technology, applied in the field of hash table processing, can solve the problems that cannot be realized at the same time, and achieve the effects of reducing throughput drop, delay delay increase, and high performance

Active Publication Date: 2021-10-15
INST OF COMPUTING TECH CHINESE ACAD OF SCI
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

None of the existing persistent hash tables can achieve the above goals at the same time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hash table processing method
  • Hash table processing method
  • Hash table processing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] The present invention will be described below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0060] Non-volatile memory (Non-Volatile Memory, referred to as NVM) is also called persistent memory (PersistentMemory, referred to as PM), which has the characteristics of byte addressability, large capacity and persistence. Pure memory storage systems, such as key-value databases, can make full use of these characteristics to store large amounts of data and achieve instant recovery after a downtime. Dynamic hashing is a core component of these storage systems, which can provide extremely high indexing performance. It expands or reduces capacity through rehash (rehashing) at runtime, and dynamically changes the size to achieve high space utilization. However, the overhead of rehash is huge, and reha...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a Hash table processing method, and a Hash table is an aggregated expandable Hash table and comprises a plurality of expandable Hash tables; each expandable Hash table forms a layer of the aggregated expandable Hash table, each expandable Hash table comprises at least one bucket, and the buckets are used for storing key value pair data; the expandable hash table has buckets with the same number to form a segment of the aggregated expandable hash table; the aggregated scalable hash table includes a shared directory to manage a global depth of the aggregated scalable hash table and pointers of segments. According to the method, the delay abrupt increase and throughput abrupt drop caused by the rehash are effectively reduced, and meanwhile, the high performance of the hash table is ensured.

Description

technical field [0001] The invention relates to the technical field of persistent hashing, in particular to a hash table processing method. Background technique [0002] Dynamic hash tables are widely used in various storage systems, especially memory databases, to achieve efficient query services. With the emergence of a new generation of non-volatile memory (Non-Volatile Memory), some researchers and companies are exploring the porting of hash tables to NVM to implement non-volatile memory databases. NVM is also called Persistent Memory (PM for short). NVM has much higher storage density than DRAM, lower power consumption and persistent capabilities. Although NVM exhibits a write latency similar to that of DRAM and a read latency 3 to 4 times higher, its latency is on the order of hundreds of nanoseconds, which is far lower than traditional persistent storage, such as solid-state drives, disks, etc. Then, building an in-memory database on NVM can not only take advantage...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22
CPCG06F16/2255Y02D10/00
Inventor 熊子威蒋德钧熊劲
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products