Expandable storage system and control method based on objects

Abstract

Combining file with block mode, the invention puts forward a brand new object interface in order to overcome disadvantages of system structure and mode of user service in current mass storage system. The system includes I pieces of metadata server, N pieces of object storage node, and M pieces of client end connected to each other. Three parties among client ends, object storage node and severs are realized. The system provides high expandability, and synchronous growth of memory capacity and collective bandwidth of data transmission. Changing traditional data management and control mode, object storage node OSN executes fussy functions for managing data at bottom layer of file system, and MS implements management of metadata. Based on object storage, the system realizes adaptive management function.

Description

technical field [0001] The invention belongs to the technical field of computer information storage, and in particular relates to an expandable object-based storage system and a control method thereof. Background technique [0002] An ideal storage system should have the following five characteristics: security, cross-platform data sharing, high performance, scalability, and intelligence. The three structures of Direct Access Storage (DAS), Network Attached Storage (NAS) and Storage Area Network (SAN) that are widely used today have different degrees of defects, and it is difficult to have the above five characteristics at the same time; the essence of these systems has never changed , that is, the basic transmission unit is block (Block) or file (File), and it lacks the intelligence and other characteristics of the storage system with object (Object) as the interface. As storage requirements increase and storage applications become increasingly complex, block or file-based...

AI Technical Summary

Problems solved by technology

However, the existing storage system still uses the external storage device mode, which does not meet the needs of network development.

The main performance is that the network storage protocol is complex (storage protocol clusters such as SCSI, ATA-5, SATA, FC, iSCSI, iFCP, USB, etc.; network protocol clusters such as IEEE802.x, ATM, TCP / IP, UDP, RTP / RTCP, FTP , GridFTP, SNMP, etc.), complex management, low efficiency, and inconvenience for customers

The existing storage device is a dumb terminal, which only contains data, metadata information is organized and managed by the host, and the storage device only responds passively; the security mechanism is implemented by the host, and the data on the storage device lacks protection (for example, a hard disk is connected to plugged into another host, its data can still be read); moreover, as mentioned earlier, the complexity of the storage protocol brings a wide variety of interfaces, and the overhead of protocol conversion is large

[0004] Due to the constraints of the traditional access mode of connecting servers and storage devices, although the capacity requirements can be met by attaching high-density and large-capacity storage devices, it cannot increase storage bandwidth at the same time.

Moreover, the I / O data on a large number of storage devices needs to be forwarded to the client through the server. This working mode not only easily leads to peripheral channel congestion, but also increases system Overhead and transmission delays, resulting in lower average data transfer rates and longer wait times for services

Especially when a large number of customers send requests, the above problems will become more prominent, forming a "server bottleneck"

Moreover, due to the low intelligence of the storage device and the low self-adaptability of the system, it cannot actively adapt to changes in the application environment. In this way, the customer's access service cannot be guaranteed, and the burden on the management personnel is increased.

Images