A method for building hbase full-text index asynchronously

Abstract

The invention belongs to the field of computer software application and provides an HBase full-text index asynchronous construction method. According to the method, HBase data in big data scenarios are subjected to asynchronous real-time construction of full-text indexes; by reading and analysis of HBase WAL logs, the full-text indexes of the data are constructed according to configurations of users. Therefore, storage and computation cost caused by extra data processing is avoided.

Description

technical field

[0001] The invention relates to computer software application technology, in particular to a method for asynchronously constructing an HBase full-text index. Background technique

[0002] With the continuous development of cloud computing technology, cloud computing technology has become an important pillar supporting the development of information technology in various industries. Distributed clusters based on Hadoop and HBase have become a popular research object of cloud computing at home and abroad. Hadoop's HDFS distributed storage provides a distributed file storage system for the cloud platform, and HBase has good read and write performance and can support tables with large amounts of data, so it is suitable for simple business and online databases with huge data volumes and data storehouse. Since HBase has relatively weak support for transactions and only supports row-level transactions, the business database is often served by mature relational dat...