Theater data accurate query method based on HBase distributed storage system

Abstract

The invention discloses a theater data accurate query optimization method based on HBase. The theater data accurate query optimization method comprises the following steps: 1) accessing the HBase by using C + + through Thrift; (2) generating a file writing interface by using Thrift, and putting an HBase. Thritf file in an HBase source code under a main directory of a root user; (3) accessing the HBase in the program; the method comprises the following steps: starting the service of HBASETHRIF2service at a server side, calling an API (Application Program Interface) to write an interface program by referring to a function definition in a generated file, applying for accessing a database from the server by a client side, and calling a Thrift function to open the connection of the database; 4) adopting a PARTITION algorithm to carry out direct connection operation, and reducing data processing time; and 5) performing computation-intensive and large-data-volume operation by using a Spark distributed computing platform, and realizing efficient query of data through the iterative computation advantage of the Spark platform.

Description

technical field [0001] The invention relates to the technical field of theater data storage and query optimization, in particular to an HBase-based precise query optimization method for theater data. Background technique [0002] According to data, for specific theater data management, there are a large number of employees and actors in the theater, and there are various types of performing arts equipment, and the quantity is also huge. Therefore, these data need to be stored in the database in a standardized manner, and the data in the database can be quickly retrieved. Inquiry, so that managers can add, delete or modify these data in a timely manner, so as to ensure the timeliness and stability of daily management and performances. Therefore, the distributed storage system Hbase is used to store data based on columns, and a direct connection query strategy is selected to provide accurate data management services. [0003] Chinese patent document CN111914155A discloses a "...

AI Technical Summary

Problems solved by technology

[0004] The present invention mainly solves the problem that the original technical solution lacks the consideration of storing a large amount of data and the optimization of the query method, which makes the data query more complicated, and provides an accurate query method for theater data based on the Hbase distributed storage system , using the HBase platform can randomly access data, write and read data can be completed according to requirements, it can completely store unstructured data, allowing flexible and dynamic data models, the storage process will not Pay attention to the data type, and at the same time transfer the entire relationship from the local site to another site when performing a connection operation in a LAN or dedicated line network, and optimize this for direct connection query, reducing the cost of query, achieving accuracy and efficiency data query and processing

Images