Data storage method and data storage devices and storage medium

A data storage device and data storage technology, applied in the field of information processing, can solve the problems of low data query efficiency and achieve the effect of improving efficiency

Active Publication Date: 2018-02-16
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF5 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem of low data query efficiency in related technologies when data query

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and data storage devices and storage medium
  • Data storage method and data storage devices and storage medium
  • Data storage method and data storage devices and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] For ease of understanding, a brief introduction is first made to relevant terms involved in the embodiments of the present invention.

[0063] Tags are a way of organizing content, which is used to characterize a certain characteristic of data and then help people describe and classify content. For example, common tags include gender, education, occupation, color, and so on. Optionally, the labels are artificially specified.

[0064] One possible implementation, the tags can include two types of enumeration tags and Boolean tags. An enumeration tag refers to a tag that includes multiple enumeration values. For example, education includes college, undergraduate, graduate, doctor, etc., and gender includes male or female; Boolean tags are only used to indicate whether the tag is available, such as , Whether you have a house, whether you have taken drugs, whether you have a criminal record, etc.

[0065] When the label is an enumeration label, the label value of the lab...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The application discloses a data storage method and data storage devices and a storage medium, and belongs to the technical field of information processing. The method includes when at least one datarecord is acquired, determining bitmaps of label values in each bitmap index partition, which is included by an bitmap index, through a preset mapping/reducing model on the basis of the at least one data record to realize storage of the at least one data record into a corresponding bitmap index partition. The bitmap index includes at least one bitmap, each bitmap corresponds to one of the label values, thus a carrying body identifier with label values can be found through the bitmap index on the basis of the label values, and efficiency of carrying out data querying on the basis of the label values is improved. In addition, the bitmaps of the label values in each bitmap index partition can be determined in parallel through the preset mapping/reducing model, and efficiency of storing data is improved.

Description

technical field [0001] The present application relates to the technical field of information processing, and in particular to a data storage method, device and storage medium. Background technique [0002] Hadoop Database (HBase) has the characteristics of distributed, high reliability, high performance, and key-value (Key-Value) storage, so more and more enterprises and users use HBase to build data tables. [0003] Usually, the data table includes multiple rows of data records, and each row of data records includes the identifier of the carrier and the tag values ​​of the labels of the carrier. For example, for user A, who has two tag values ​​of gender "female" and occupation "engineer", the row corresponding to user A in the data table includes user A's identity, tag value "female" and tag value " engineer". That is, the data table records the corresponding relationship between the identifier of the carrier and the tag value it has. [0004] Based on the above-mention...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/182G06F16/2237G06F16/2282G06F16/23
Inventor 钟超强毕杰山
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap