Multimedia file cloud storage platform and method for eliminating redundancy by using cloud storage platform

Abstract

The invention discloses a multimedia file cloud storage platform and a method for eliminating redundancy by using the cloud storage platform, and belongs to the field of information processing. The multimedia file cloud storage platform comprises a storage interface management subsystem, a cluster management subsystem and a storage management subsystem, wherein the storage interface management subsystem is used for generating an operation instruction and used for communicating with the cluster management subsystem or the storage management subsystem. The method for eliminating redundancy by using the cloud storage platform comprises the following steps: firstly, calculating fingerprint information of an uploaded file, generating a verification instruction, transmitting the verification instruction to the cluster management subsystem to be judged, if the fingerprint information is available, checking a corresponding file metadata instruction, and feeding back a result; or else verifying the fingerprint information of the file, and transmitting a result; continuously judging whether the cloud storage platform has identical files or not, if the cloud storage platform has identical files, transmitting a redundancy record adding instruction, and uploading a result; and if the cloud storage platform does not have identical files, storing the files, adding instructions, and uploading a result. By adopting the method, the storage load of a storage server can be reduced, and file transmission between a user and the cloud storage platform can be accelerated.

Description

technical field [0001] The invention belongs to the field of information processing, in particular to a multimedia file cloud storage platform and a method for removing redundancy using the cloud storage platform. Background technique [0002] With the widespread application of cloud computing technology, more and more cloud platforms provide users with data storage, query and computing services. When applications store a large number of multimedia files such as pictures, videos and audios, due to the The characteristics of long cycle and frequent visits. Although the use of distributed storage can improve the access efficiency of multimedia files, it can avoid the delay caused by network transmission bottlenecks for multimedia file access and the throughput performance degradation caused by disk storage space bottlenecks for multimedia file storage. However, the multimedia file upload portal provided by many applications to users will cause the cloud storage platform to ac...

AI Technical Summary

Problems solved by technology

However, the multimedia file upload portal provided by many applications to users will cause the cloud storage platform to accumulate a large amount of repeated data. All users can set up special topics for their loved ones, which makes them very likely to upload the same multimedia files related to the same relative. However, the current cloud storage service for multimedia files is subject to many restrictions, as follows:

[0003] 1. Limitation of storage cost: The expansion of Moore's Law makes the consumption of storage faster and faster. Controlling the growth of storage is not an easy task. In the current cloud computing environment, many companies are developing applications to store user files Sometimes, due to the limitation of investment and other reasons, too many resources cannot be invested in the storage of multimedia data files;

[0004] 2. Limitation of network transmission speed: It takes a certain amount of time to upload multimedia files. If the network status is not good, if the user spends a long time uploading an existing file on the cloud storage platform, on the one hand, it will affect the user experience. Bad influence, on the other hand, it will add extra storage cost to the system;

[0005] 3. Limitation of disk storage space: The disk space on the storage server is limited, and it is inevitable that the storage server will run out of disk space after running for a period of time. If the storage server needs to be shut down when expanding the capacity, the user will The inability to upload and access files through the application detracts from the user experience

[0006] 4. Restrictions on user data access security: The storage services provided by the cloud storage platform for applications need to ensure user data access security and storage security. If the security of user files cannot be guaranteed, users will refuse to use them, and even make applications The developers of the programs are at risk of being sued

The cloud storage platform also needs to restrict user files from being stolen by web crawlers according to certain rules, and restrict third-party applications from accessing files stored in the cloud storage platform

Images