Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data migration method, device and system between Elastic Search clusters

An inter-cluster and data technology, applied in the Internet field, can solve problems such as inability to solve data synchronization, does not support data migration of different versions of ES, does not have multi-table association, consistency and transactionality of general relational databases

Pending Publication Date: 2021-07-30
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

ES can be regarded as a database when used as a query function, but it does not have the characteristics of multi-table association, consistency, and transactionality of general relational databases. The file is fixed and does not support data migration between ES clusters of different versions, so it cannot solve the problem of data synchronization between old and new ES clusters during product upgrades

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data migration method, device and system between Elastic Search clusters
  • Data migration method, device and system between Elastic Search clusters
  • Data migration method, device and system between Elastic Search clusters

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0049] It should be noted that a data migration method, device and system between Elastic Search clusters disclosed in this application can be used in the field of artificial intelligence technology, and can also be used in any field other than the field of artificial intelligence technology. The Elastic Search cluster disclosed in this application The application fields of the data migration method, device and system between the devices are not limited.

[00...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data migration method, device and system between Elastic Search clusters, which can be used in the technical field of artificial intelligence, and the method comprises the following steps: writing all indexes to be migrated in a source ES cluster into a preset migration queue; according to the technical scheme, the method comprises the following steps: automatically discovering new words based on a user search log; determining the number of parallel tasks and the migration speed of parallel migration according to the migration configuration file; and starting a data migration process corresponding to the number of the parallel tasks, and transmitting the to-be-migrated indexes corresponding to the number of the parallel tasks to the target ES cluster according to the migration speed. According to the data migration method and device, data batch migration of ES clusters of different versions can be achieved, and the data migration efficiency of the ES clusters is improved.

Description

technical field [0001] The present invention relates to the technical field of the Internet, in particular to a data migration method, device and system between Elastic Search clusters. Background technique [0002] Elastic Search (ES for short) is a distributed, highly scalable, high real-time search and data analysis engine that can be used to store index data (an index is equivalent to a table in a traditional database), providing users with more flexible online Data query service. When using ES, it is often necessary to migrate the index data in the ES cluster due to reasons such as data backup, product upgrade, and cluster relocation. ES can be regarded as a database when used as a query function, but it does not have the characteristics of multi-table association, consistency, and transactionality of general relational databases. The file is fixed, and does not support data migration between ES clusters of different versions, so it cannot solve the problem of data sy...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/21G06F16/22
CPCG06F16/214G06F16/2228
Inventor 梁晔华张世瑛赵吉昆杨嘉欣
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com