Secondary index creation method and device for horizontal partition table, equipment and storage medium

Abstract

The invention discloses a method, a device and equipment for creating a secondary index of a horizontal partition table and a storage medium. The method comprises the steps that after a secondary index creating instruction is received, the index state of a secondary index of a partition root table in a horizontal partition table corresponding to the instruction is set to be an invalid state; performing index data filling on secondary indexes of corresponding leaf layer partition sub-tables in the horizontal partition table through the distributed asynchronous sub-tasks; and after detecting that each leaf layer partition sub-table completes index data filling, setting the index state of the secondary index of the partition root table as an effective state, and obtaining the secondary index. According to the embodiment of the invention, the index data filling is carried out on the secondary index of the corresponding leaf layer partition sub-table in the horizontal partition table through the distributed asynchronous sub-task, so that the problem that the time consumption is relatively long when the secondary index is created is solved, the efficiency of creating the secondary index is improved, and the user experience is improved.

Description

technical field [0001] The embodiments of the present invention relate to the field of databases, and in particular to a method, device, device and storage medium for creating a secondary index of a horizontal partition table. Background technique [0002] When the data volume of the partition table is very large, it takes a long time to create the secondary index. The solutions of major database vendors mainly include: async asynchronous index creation and parallel index creation with specified parallelism. Among them, the async asynchronous index creation of the Hbase database can be divided into two steps: the first step is to use the async method to create an asynchronous index. After the execution is completed, the index status is invalid, and there is no data in the index; the second step is to fill the index data into The target file, after the execution is completed, the index is updated to a valid state. During the process of creating an index asynchronously, if t...

AI Technical Summary

Problems solved by technology

[0003] It can be seen that async asynchronous index creation does not really improve the efficiency of index data filling, but only splits the index creation into two parts; parallel specifies the degree of parallelism to create an index is to hand over one SQL to multiple processes to complete the work together, using N times Resource consumption in exchange for time, however, the index b-tree must be filled with data in an orderly manner, and when the index data is filled, the coupling between the producer and the consumer is too high, which will reduce the parallel efficiency

Images