Data processing method, apparatus, device, medium, and program product

Abstract

This application provides a data processing method, apparatus, device, storage medium, and program product, relating to the field of distributed technology and applicable to the financial technology sector. The method includes: allocating the total amount of data to be processed to k clusters according to a first allocation ratio, where the first allocation ratio is the proportion of first available resources in each of the k clusters, and k is an integer greater than 1; allocating data blocks allocated to the clusters to r physical machines in the clusters according to a second allocation ratio, where the second allocation ratio is the proportion of second available resources in each of the r physical machines, and r is an integer greater than or equal to 1; processing the allocated data sub-blocks through the physical machines to obtain processing results; and summarizing the processing results from each of the k physical machines in the clusters to obtain the final processing result of the data to be processed.

Images