The invention provides a large-scale Hadoop cluster
virtual machine placement method based on multi-objective optimization, a
system model of a Hadoop cluster comprises a plurality of racks, a plurality of physical machines (PMs) are configured in each rack, and a plurality of virtual machines (VMs) run on each physical
machine; the Hadoop cluster performs data block transmission and file copy
copying through a switch, so that cross-rack
data synchronization and load balancing are realized; the optimization objective of the
system model of the Hadoop cluster is to minimize the weighted sum of
energy consumption, resource waste and file access
delay of the Hadoop cluster, a variable-length
chromosome structure composed of
virtual machine chromosomes and block chromosomes is used in the method adopted by the optimization objective, and the
chromosome structure is used for expressing the positions where virtual machines and data block copies are placed. A
chromosome structure uses
crossover and
mutation operation to enhance diversity of solution
space exploration of resource configuration in a
virtual machine placement process; according to the method, dynamic changes of resource requirements in the Hadoop cluster operation process are fully considered, and it can be ensured that the Hadoop cluster keeps good performance under the high-load condition.