Index migration method and device, electronic equipment and storage medium

Abstract

The invention discloses an index migration method and device and electronic device. The method comprises the steps: obtaining a first request according to a target task queue, wherein the first request is used for updating a first index of target data, and the target data is incremental data received by a search engine in the index migration processing process; according to the first request, updating the first index, and according to execution states of all requests in the first request, obtaining first state information; under the condition that the first state information shows that the first request is successfully executed, executing second index updating processing of the target data, wherein the structure of the second index is different from that of the first index. According to the method, smooth migration of the data on the new and old indexes can be conveniently and efficiently realized.

Description

technical field [0001] The present disclosure relates to the technical field of the Internet, and more specifically, to an index migration method, device, electronic equipment, and computer-readable storage medium. Background technique [0002] With the continuous development of Internet technology, in order to quickly provide data to users, applications can generally manage data in applications through search engine products, such as ElasticSearch (hereinafter referred to as ES), Solr, OpenSearch and other search engine products. [0003] Taking ES as an example, the current search engine products can realize functions such as fast retrieval of data, data aggregation, and data modeling by creating indexes. Among them, when creating an index, the structure of the index can be defined through mapping. It can include defining the fields included in the index, the data types of the fields, and index attributes. However, in practice, there may be situations where the existing d...

AI Technical Summary

Problems solved by technology

However, in practice, there may be situations where the existing designed mapping cannot meet the needs of data growth. Since the existing search engine does not support operations such as field deletion and field data type change on the original index mapping structure, it is often the case at this time The mapping needs to be redesigned, and the index is rebuilt based on the redesigned mapping, and the old index data is migrated to the new index after the change

[0004] In the process of implementing this application, the inventors found that when index migration is performed in the existing method, for the incremental data received during the migration process, the developer often develops a migration script (Script) to realize the old and new indexes. Data double-writing function. On the one hand, this method requires developers to develop in real time according to the existing situation, resulting in inconvenient migration processing; The possibility of inconsistency, therefore, synchronous writing is often used to double-write index data, which has the problems of high complexity and low efficiency

Images