The invention provides a
big data platform scheduling task and data collaborative smooth migration method and
system, and relates to the technical field of
big data, and the method comprises the steps: constructing a digital twin environment of a target
system, collecting task operation state data of a
source system, extracting task features through a deep neural network, and carrying out the clustering and grouping. And deploying the
task group to a digital twin environment, analyzing a task association relationship and a resource competition relationship based on a graph neural network, and generating a task stability
score in combination with a task operation index. And constructing a migration risk prediction model to perform quantitative evaluation on the migration risk, and determining a migration priority and an execution sequence according to the quantitative evaluation. And making corresponding resource configuration,
data synchronization and fault
recovery plans for each
task group, carrying out migration drilling in a digital twinning environment, and optimizing a migration scheme by utilizing a
reinforcement learning algorithm. The migration risk can be effectively reduced, the smoothness and stability of the migration process are guaranteed, and the migration efficiency is improved.