Unlock instant, AI-driven research and patent intelligence for your innovation.

Data migration and information determination method, data processing system and electronic equipment

A technology of data and migration volume, applied in the computer field, to prevent resource shortage, improve rationality, and solve the effect of overly conservative migration planning

Inactive Publication Date: 2020-06-09
ALIBABA GRP HLDG LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of the problems existing in the existing manual formulation of data migration rules, each embodiment of the present application provides a highly automated and relatively reasonable data migration and information determination method, data processing system, and electronic equipment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data migration and information determination method, data processing system and electronic equipment
  • Data migration and information determination method, data processing system and electronic equipment
  • Data migration and information determination method, data processing system and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] Before introducing the technical solutions provided by the various embodiments of the present application, a brief description of the proper nouns involved in this article is given.

[0061] The big data general processing platform is used to provide distributed processing capabilities for TB / PB level data with low real-time requirements, and to apply data analysis, mining, business intelligence and other fields, providing users with a complete data import solution and a variety of The classic distributed computing model can solve users' massive data computing problems more quickly, effectively reduce enterprise costs, and ensure data security. The big data general processing platform mainly serves the storage and calculation of batch structured data, and can provide solutions for massive data warehouses and analysis and modeling services for big data. The big data general processing platform can contain multiple clusters.

[0062] A cluster (cluster) includes multiple...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data migration and information determination method, a data processing system and electronic equipment. The data migration method comprises the steps of obtaining a migration amount required by a first cluster and an receivable amount of at least one second cluster; determining target information related to network resource consumption caused by migrationof the data on the first cluster to any second cluster based on the dependency relationship between the data; determining a migration scheme according to the target information, the to-be-migrated amount and the receivable amount of the at least one second cluster; wherein the migration scheme comprises target data capable of being migrated on the first cluster and a target cluster capable of receiving the target data in the at least one second cluster. According to the embodiment of the invention, the inter-data dependence, the to-be-migrated amount of the cluster and the receivable amount of the cluster are integrated, and the formulated migration scheme is more objective and closer to the actual situation; compared with existing manual planning migration, the problem that migration planning made by operation and maintenance personnel is conservative in the prior art can be effectively solved.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a method for data migration and information determination, a data processing system, and electronic equipment. Background technique [0002] The core computing component of the big data processing system undertakes most of the distributed computing requirements. The core computing components of a big data platform usually include multiple clusters, which can be distributed in different regions and provide services for thousands of applications. [0003] A cluster has resources in multiple dimensions such as computing, storage, and number of files. When the resource usage of any cluster reaches a certain level, some data on the cluster needs to be migrated. Currently, data migration between clusters depends on the experience of operation and maintenance personnel. Usually, the migration plan made by the operation and maintenance personnel is generally conservative. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5088
Inventor 张颖莹
Owner ALIBABA GRP HLDG LTD