Data migration method and device and electronic device
A data and database technology, applied in the computer field, can solve problems affecting the normal use of Solr services
Active Publication Date: 2019-08-09
HANGZHOU HIKVISION DIGITAL TECH
View PDF7 Cites 1 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, this method uses the Http interface during the data reading process, which affects the normal use of the Solr service
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment approach
[0166] As an implementation manner of an embodiment of the present invention, the device further includes:
[0167] The conversion module is configured to convert the Solr data into an elastic distributed dataset RDD according to the field information of the configured Solr data.
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
Embodiments of the invention provide a data migration method and device and an electronic device. The method comprises the steps of reading Solr data stored in a Solr system through a distributed memory component Spark; obtaining a corresponding relation between the configured Solr data and a target database table structure; and loading the Solr data into the target database table according to a corresponding relationship between the Solr data and a target database table structure. In the embodiment of the invention, the distributed memory component Spark is adopted to read the Solr data stored in the Solr system, then the read Solr data is loaded into another database, and the Solr data does not interact with the Solr service in the migration process, so that the normal use of the Solr service is not influenced.
Description
technical field [0001] The invention relates to the technical field of computers, in particular to a data migration method, device and electronic equipment. Background technique [0002] Solr is an independent enterprise-level search system that can provide indexing services by indexing data and can also be used to store data. When the Solr system is upgraded and storage components are replaced, the data stored in Solr needs to be migrated to new storage components, such as the Hbase database, thus requiring a data migration method for the Solr system. [0003] Data migration refers to the process of migrating data from one storage system to another. A known method for migrating data in the Solr system is to read the data through the http interface provided by Solr, and then store the data in another storage system. However, this method uses the Http interface during the data reading process, which affects the normal use of the Solr service. Contents of the invention ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/22G06F16/25
CPCG06F16/214G06F16/2282G06F16/258
Inventor 李冰杰王辉
Owner HANGZHOU HIKVISION DIGITAL TECH