Method for constructing HBase cluster full-text index, data reading method and data writing method

A full-text indexing and clustering technology, applied in the field of HBase clusters, can solve problems such as increasing storage and computing overhead, and achieve the effects of avoiding storage and computing overhead, small performance impact, and good timeliness

Active Publication Date: 2017-10-20
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF7 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method needs to store data in the message queue, and requires programming to implement stream computing, which increases storage and computing overhead

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for constructing HBase cluster full-text index, data reading method and data writing method
  • Method for constructing HBase cluster full-text index, data reading method and data writing method
  • Method for constructing HBase cluster full-text index, data reading method and data writing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the purpose, features and advantages of the present invention more obvious and understandable, the technical solutions protected by the present invention will be clearly and completely described below using specific embodiments and accompanying drawings. Obviously, the implementation described below Examples are only some embodiments of the present invention, but not all embodiments. Based on the embodiments in this patent, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this patent.

[0031] This embodiment provides a method for constructing an HBase cluster full-text index, such as figure 1 As shown, the methods include:

[0032] S1, configure Zookeeper in the HBase cluster, and create a full-text index Table_Index table;

[0033] S2, the HBase cluster configures all nodes of the cluster into a queue based on Zookeeper, and stores the read WAL log of each node in the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for constructing an HBase cluster full-text index, a data reading method and a data writing method. The method for constructing the HBase cluster full-text index includes the steps that Zookeeper is configured in an HBase cluster, and a full-text index Table_Index table is built; the HBase cluster configures all nodes of the cluster into a queue based on Zookeeper, and reading WALs of the nodes are stored in the queue; individual threads are started at corresponding node bits in the Table_Index table, and the WALs of the nodes are made to correspond to the node bits of the Table_Index table according to the sequence of the queue, wherein the reading WAL and the started thread of one HBase cluster node are set on each node bit. The method for constructing the full-text index for HBase cluster data has high timeliness and avoids storage and calculation expenditure brought by extra data processing.

Description

technical field [0001] The invention relates to the field of HBase clusters, in particular to a method for constructing an HBase cluster full-text index, a data reading method and a data writing method. Background technique [0002] With the continuous development of cloud computing technology, cloud computing technology has become an important pillar supporting the development of information technology in various industries. Distributed clusters based on Hadoop and HBase have become a popular research object of cloud computing at home and abroad. Hadoop's HDFS distributed storage provides a distributed file storage system for the cloud platform, and HBase has good read and write performance and can support tables with large amounts of data, so it is suitable for simple business and online databases with huge data volumes and data storehouse. Since HBase has relatively weak support for transactions and only supports row-level transactions, the business database is often se...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2282G06F16/27
Inventor 臧勇真
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap