Network-aware virtual machine mirroring storage system and read-write request handling method

Abstract

The invention discloses and provides a network-aware virtual machine mirroring storage system. The network-aware virtual machine mirroring storage system comprises a private cache management module, a public cache management module, a network monitoring module, a decision module and a dynamic addressing module; the private cache management module, the public cache management module, the network monitoring module and the dynamic addressing module are arranged at a computational node; the decision module is arranged at a management node. The invention also discloses a network-aware virtual machine mirroring storage system based read-write request handling method to enable nodes with lighter network loads to process more mirroring access requests and nodes with heavier network loads to process less mirroring access requests and accordingly I / O hotspots are avoided, and overall network load is balanced; appropriate purpose nodes can be selected for every virtual machine in a self-adaptive mode according to communication modes and the network utilization conditions of a current virtual machine, the network load of a data center can be balanced, and a bottleneck problem in read and write of the virtual machine caused by network congestion is solved.

Description

technical field [0001] The invention belongs to the technical field of cloud computing and virtualization, and more particularly relates to a network-aware virtual machine image storage system and method. Background technique [0002] In the cloud platform, users can lease virtual machines to use computing, storage, and network resources. As a container for storing virtual machine data, the virtual machine image directly affects the read and write performance of the virtual machine. Therefore, in the cloud platform, efficient Virtual machine image storage is particularly critical. [0003] Traditional virtual machine image storage is divided into three categories: back-end centralized storage, back-end centralized storage + computing node stand-alone cache, back-end centralized storage + computing node collaborative cache; back-end centralized storage, usually using a dedicated The shared storage server of the shared storage server is used as the virtual machine image wareh...

AI Technical Summary

Problems solved by technology

[0003] Traditional virtual machine image storage is divided into three categories: back-end centralized storage, back-end centralized storage + computing node stand-alone cache, back-end centralized storage + computing node collaborative cache; back-end centralized storage, usually using a dedicated The shared storage server of the shared storage server is used as the virtual machine image warehouse, and the virtual machines on different computing nodes can directly access the required image remotely, or use the method of distributing the image files in the storage server to the local computing node for use; this method Easy to manage, but with the expansion of the data center or cloud platform, the back-end centralized storage can easily become the I / O bottleneck

[0004] Back-end centralized storage + computing node stand-alone cache method, in order to reduce the number of accesses to the back-end centralized storage, the method of adding a cache to the local disk of the computing node is used to cache hot data in the back-end storage; this method is compared with The back-end centralized storage efficiency is greatly improved, but due to the limited disk space on a single node, as the types of virtual machines increase, the local cache with limited size usually cannot perform well

[0005] Back-end centralized storage + cooperative caching between computing nodes allows a virtual machine on a certain computing node to access data in the disk cache of other computing nodes. The caches of all computing nodes form a large distributed storage pool, making virtual The cache hit rate of machine read and write is greatly improved; however, since the virtual machine depends on the inter-node network when accessing the cache in other computing nodes, and the communication between virtual machines or external services also depends on this network, the access to the virtual machine image The generated network traffic and the network traffic generated by virtual machine communication are in a competitive relationship and affect each other; if the computing node that stores the hotspot image data happens to be a node with intensive communication between virtual machines, then this node will become a bottleneck, making the virtual machine The performance of the mirror storage system is greatly reduced, and even degenerates to the same situation as without caching

Images