Storage system and management method of massive unstructured data

Abstract

The invention discloses a storage system of massive unstructured data. The storage system of the massive unstructured data comprises an online storage pool which is composed of high speed storage arrays and achieves real time high speed storage and access of the unstructured data of various terminals or application systems, a near line filing pool which is composed of high-capacity storage arrays and achieves regular filing and backup of online storage pool data, an offline filing pool which is composed of high-capacity tape libraries and achieves regular filing and backup of near line filing pool data, and the various terminals or application systems which produce and actually use devices of the unstructured data. According to the storage system of the massive unstructured data, the invention further discloses a management method of massive unstructured data storage. According to the storage system and the management method of the massive unstructured data, unified space management functions based on the storage pool are provided, petabyte (PB) grade storage capacity and concurrent access of thousands of clients are supported, management of various storage devices is simplified, and cost of the storage systems and capital expenditure are saved at the same time.

Description

Technical field [0001] The present invention relates to the field of communications, in particular to a storage system and management method for massive unstructured data. Background technique [0002] With the rapid popularization of the Internet, various terminals and desktop systems, such as smart phones, PADs, notebooks, desktop computers, and other devices are increasing, resulting in faster and faster system data production, showing a geometric expansion trend. In the long run, these There are more and more data and files accumulated on the data production system. A large number of various reports, data and other files scattered in the terminal and application system will cause the performance of the production system to become slower and slower, and it is impossible to find data quickly and effectively. Increasing system performance by adding servers and storage devices, the cost is getting higher and higher; at the same time, with the continuous increase of data, the amou...

AI Technical Summary

Problems solved by technology

[0002] With the high-speed popularization of the Internet, there are more and more various terminals and desktop systems, such as smart phones, PADs, notebooks, desktop computers and other devices, resulting in faster and faster system data production, showing a geometric expansion trend. In the long run, these There are more and more data and files accumulated on the data production system, and a large number of various reports, data and other files scattered in the terminal and application system will cause the performance of the production system to become slower and slower, making it impossible to quickly and effectively search for data. Increase system performance by adding servers and storage devices, the cost is getting higher and higher; at the same time, the data is increasing continuously, the amount of data is too large, backup is becoming more and more difficult, and whether the system can be restored in the event of a failure becomes more and more uncertain; Although there is RAID hot backup technology, the added devices, especially hard disks, will bring more system failure points to the system, and the system will enter a vicious circle that is becoming more and more difficult to maintain

[0003] At present, many enterprises provide cloud storage solutions using servers, but access speed and storage capacity have always been an inherent contradiction in storage. Using traditional NAS servers for file storage has capacity limitations, requiring enterprises to continuously add new ones. Appliances to handle newly increased data storage requirements and unpredictable workloads

This will lead to rising costs, including equipment implementation, space occupation, energy and daily IT management costs. There is currently no efficient way to find the required data for stored data and files

Images