Data storing, managing and inquiring method and system for distributed key-value storage system

A technology of data storage and data storage system, applied in the field of data storage, management and query mechanism, can solve the problems of reducing the application scope of text-based distributed databases, unable to realize multi-attribute retrieval of structured data, numerical statistics and analysis, etc. Achieve the effect of rich data query methods

Inactive Publication Date: 2012-01-25
INST OF COMPUTING TECH CHINESE ACAD OF SCI
View PDF7 Cites 49 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It can be seen that this distributed text storage system based on column storage is no longer applicable to the application scenarios of complex queries, and cannot realize multi-attribute retrieval, numerical statistics, analysis and other operations of structured data
This limitation reduces the scope of application of text-based distributed databases in large data sets and structured data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storing, managing and inquiring method and system for distributed key-value storage system
  • Data storing, managing and inquiring method and system for distributed key-value storage system
  • Data storing, managing and inquiring method and system for distributed key-value storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below through specific embodiments in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0052] In one embodiment, a data storage method for a distributed KEY-VALUE data storage system is provided. Before storing the data, this method converts the data into ordered strings according to different data types, and then saves them in the distributed KEY-VALUE data storage system. The converted strings are in lexicographical order The sorted storage order is consistent with the numerical order before conversion, so as to support the storage and retrieval of complex data types such as INTEGER (integer), as well as user-defined data types, such as the IPFIELD type used to store I...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data storing, managing and inquiring method and system for a distributed key-value storage system. The method comprises the following steps: before storing data, respectively converting data into ordered character strings according to different data classifications and then storing the ordered character strings into the distributed key-value storage system, wherein storage sequences of the converted character strings sequenced according a dictionary sequence are consistent with numerical value sequences before conversion; and during data retrieval, the same conversion is carried out on the numerical values in retrieval conditions. The method provided by the invention supports storage and retrieval of complex data classifications and includes complex data inquiring methods, such as multi-field attribute inquiring, multi-data classification inquiring, numerical value statistic analysis and the like.

Description

technical field [0001] The invention belongs to the field of information security, and in particular relates to a data storage, management and query mechanism in a distributed key-value (KEY-VALUE) text data storage system. Background technique [0002] At present, e-commerce, system operation logs, and web applications have accumulated a large amount of text data, which is huge in scale. Even small enterprises have collected terabytes of data. For the application background of such large data sets, traditional databases is no longer applicable. At present, the successful solution for such scenarios is to use distributed KEY-VALUE type NO-SQL databases to improve data compression efficiency and storage scale by establishing a column storage structure and combining technologies such as compression and partitioning. Because the text data type is simple and intuitive, it is easy to migrate in heterogeneous cluster systems. At present, typical large-scale distributed mass data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 吴广君郝丽珍王树鹏云晓春安丰春
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap