A hbase secondary index query and storage system and its query method

A storage system and secondary index technology, applied in the field of data processing, can solve the problems of low efficiency, large data storage redundancy, and large data redundancy, and achieve the effects of reducing storage redundancy, improving query efficiency, and high query efficiency.
CN105302869BActive Publication Date: 2020-01-17FENGHUO COMM SCI & TECH CO LTD
1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
FENGHUO COMM SCI & TECH CO LTD
Publication Date
2020-01-17

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The present invention relates to the technical field of data processing, in particular to an HBase secondary index query and storage system and query method. The HBase secondary index query and storage system comprises a client, a query processing module, a query execution engine module and an HBase storage module. According to the HBase secondary index query and storage system and query method, filter columns originally stored in each index table are combined into a main filter column table to enable filter column data requiring redundancy to be greatly reduced, thereby reducing storage redundancy of data; and meanwhile, the queries to all index tables are finally integrated into the query to the main filter column table through a mixer filter, the main filter column table is stored in a rapid storage medium at the same time, and the query efficiency is relatively high; moreover, the query efficiency is greatly improved by using the rapid random access performance of an SSD hard disc.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the technical field of data processing, in particular to an HBase secondary index query and storage system and a query method thereof. Background technique

[0002] With the development and application of big data technology, HBase has gradually become a NoSQL distributed storage system widely used in the industry. It is highly reliable, column-oriented, and open source, and has been successfully used in production systems by companies such as Facebook and Alibaba. How to efficiently store and query secondary indexes on HBase is a research hotspot in the industry. At present, the widely used scheme architecture is as follows: image 3 As shown, the solution mainly includes three modules: HBase storage module, query processing module, and query execution engine. The HBase storage module is responsible for the storage of original data and index data. It has the characteristics of distributed, large capacity, and fast response. Si...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More