A chained log storage structure and its hash index structure, data operation method, server, and medium

A hash index and data storage technology, applied in the IT field, can solve the problem of low memory utilization, achieve fast query speed, avoid internal fragmentation, and low memory fragmentation rate

Active Publication Date: 2020-12-04
INST OF INFORMATION ENG CHINESE ACAD OF SCI
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The public overflow area is only suitable for scenarios with fewer storage elements
In addition, the current dynamic memory allocation method has the problem of memory fragmentation, which leads to low memory utilization, and the overhead of memory cache system resources cannot be ignored.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A chained log storage structure and its hash index structure, data operation method, server, and medium
  • A chained log storage structure and its hash index structure, data operation method, server, and medium
  • A chained log storage structure and its hash index structure, data operation method, server, and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments.

[0052] The design of the data storage management structure of the present invention is as follows: figure 2 shown.

[0053] The size of each segment (storage segment) in this structure is 2MB, and the data is inserted from the head pointer position. If the remaining space of the current segment is insufficient, a new segment is mapped to the adjacent position of the current segment through the mmap call. An array is used to store the meta information of all segments, and each meta information includes the starting address of the segment, the address of the first element (that is, the first log item in the segment), and the storage position of the meta information of the adjacent segments in the array (that is, the adjacency The array subscript of Segment meta information, each array element is a meta information structure, the reason why the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a chain log storage structure, a hash index structure and a data operation method thereof, a server and a medium. The chain log storage structure comprises a plurality of storage segments and an array; a storage unit of each storage segment is a log entry; the log entry includes an initial size field, an index position field, a key length field, a Key field and a Value field, wherein the Value field is used for storing data; the Value field is used for storing data keys; the initial size field is used for storing an initial size of the storage log entry; the index position field is used for storing the position of an index of the log entry in a hash table; and the array is used for storing meta information of each storage segment. The hash index structure comprises a plurality of hash buckets; and a data structure of each hash bucket includes an index number field, a valid mark field, a label field, an offset field and an extension bucket field. According to the chain log storage structure, the hash index structure and the data operation method thereof, the server and the medium, the close continuity of the whole structure memory can be maintained and the fragmentation rate is reduced.

Description

technical field [0001] The invention belongs to the field of IT technology, and relates to a NoSql memory database-data storage structure, in particular to a chained log storage structure and a hash index structure, a data operation method, a server, and a medium. Background technique [0002] Cyberspace resource surveying and mapping is a unified description, comprehensive perception and panoramic depiction of cyberspace resources. The detection, analysis, and mapping of cyberspace resources are of great significance to my country's building into a cyber power. However, cyberspace resources are large in scale and dynamically time-changing. Therefore, an efficient resource caching strategy is needed to deduplicate resources. Storage and efficient query support business users to fully grasp the characteristics and distribution of network space resources. [0003] In addition, with the development of the Internet, the Internet has more and more profound impact on people's dail...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/2455
CPCG06F16/2255G06F16/24552
Inventor 刘庆云杨泞构刘俊朋张鹏郑超杨嵘
Owner INST OF INFORMATION ENG CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products