A file storage system based on blue light

By designing a file storage system based on Blu-ray, using the combination of cache module and disk library management module, the problem of difficult to efficiently store large-scale and long-term cold data in the existing technology is solved, low-energy storage and management are achieved, and storage is improved System convenience and security.

CN113111039BActive Publication Date: 2024-11-26HUALU OPTICAL STORAGE RES INST DALIAN CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110419340.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-04-19
Publication Date
2024-11-26
Estimated Expiration
2041-04-19

AI Technical Summary

Technical Problem

The prior art lacks a storage system that can efficiently and securely store large-scale and long-term cold data, and has the characteristics of low energy consumption.

Method used

A file storage system based on Blu-ray is designed, including a page management module, a mount module, a cache management module and a disk library management module. The file upload, download, burn and read can be realized through the FUSE interface, and the cache module is divided into elements Data cache, write cache, burn cache and read cache manage these modules for file storage and management.

Benefits of technology

Without changing user habits, the system provides efficient file storage and management functions, supports regular file system interfaces, can be easily mounted to any operating system, improving the convenience of Blu-ray storage and data security .

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113111039B_ABST
    Figure CN113111039B_ABST
Patent Text Reader

Abstract

The present invention discloses a file storage system based on blue light, including a management page module for adding / deleting a cartridge group through a disk library management module; a mounting module for mounting the cartridge group under the path of the system by implementing a FUSE interface, so that the client can upload and download from the mounting point; a cache management module for dividing the cache into metadata cache, write cache, burn cache and read cache, and managing the four caches; and a disk library management module for burning files to the cartridge and reading files from the cartridge. The system uses the FUSE interface to realize the file system to upload and download files without changing the user's usage habits, which greatly improves the convenience of using blue light.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data management, and in particular to a file storage system based on blue light. Background Art

[0002] With the development of Internet technology, we have entered the era of big data. With the popularization of the Internet and the Internet of Things, the amount of information storage is increasing, and the requirements for information reliability are becoming higher and higher.

[0003] The current storage media is mainly disks. The characteristics of disks are fast storage and support for multiple read and write operations, which are particularly suitable for frequently accessed data.

[0004] With the increase in data volume and the characteristics of the Internet, the possibility of accessing data older than one day has gradually decreased, and it has become cold data. This part of cold data cannot be thrown away and needs to be stored for a long time, which requires a product with large storage capacity, long life and low energy consumption to solve this problem. Blu-ray storage happens to have these characteristics and can solve these problems very well.

[0005] Moreover, Blu-ray storage has the characteristic of being non-erasable and can ensure the security of data, but the prior art lacks such a system to achieve the above purpose. Summary of the invention

[0006] In view of the above problems, the present invention proposes a file storage system based on blue light.

[0007] The technical means adopted by the present invention are as follows:

[0008] A file storage system based on blue light, comprising:

[0009] Management page module, used to add / delete tray groups through the tray library management module;

[0010] A mounting module, used for mounting the cartridge group to the cartridge group operation path of the system through the FUSE interface, so that the client can perform file upload and download operations from the cartridge group operation path of the system;

[0011] a cache management module, used to divide the cache module into a metadata cache module, a write cache module, a burn cache module and a read cache module, and manage the four cache modules; and

[0012] The disk library management module is used for recording files to the disk cartridge group and reading files from the disk cartridge group.

[0013] Furthermore, the process of mounting the cartridge group to the cartridge group operation path of the system through the FUSE interface, and enabling the client to upload and download files from the cartridge group operation path of the system includes the following process;

[0014] When the mounting module receives the file upload instruction sent by the client, the mounting module creates a metadata file in the metadata cache module and writes the metadata into the metadata file; the mounting module creates an entity file in the write cache module and writes the entity data into the entity file;

[0015] When the mounting module receives the file download instruction sent by the client, the mounting module controls the cache management module to send a file read request to the disk library management module;

[0016] When the mounting module receives the file list request sent by the client, the mounting module traverses the metadata file to obtain a metadata directory list, and sends the metadata directory list to the client.

[0017] Furthermore, the cache management module manages the metadata cache module, the write cache module, the burn cache module and the read cache module, including:

[0018] When the physical data in the write cache management module reaches a certain threshold, the cache management module controls the write cache module to move the physical data to the burn cache module, and after the physical data is moved to the burn cache module, sends a burn request to the disk library management module;

[0019] When the cache management module receives the file burning completion instruction, the cache management module controls the burning cache module to delete the currently burning file, and sends an update instruction to the metadata cache module to update the metadata file;

[0020] When the cache management module receives a file download instruction sent by the client, the cache management module sends a read request instruction to the cartridge management module;

[0021] The cache management module is also used to record the storage time of the read cache file in the read cache module. When the storage time is greater than a certain threshold, the read cache file is determined to be an expired file, and the read cache module is controlled to delete the read cache file.

[0022] Furthermore, the process of the disk library management module burning files to the disk cartridge and reading files from the disk cartridge includes:

[0023] When the disk library management module receives a burning request, it burns the file in the burning cache module to the disk cartridge group, and after the file burning is completed, it sends a file burning completion instruction to the buffer management module, and simultaneously obtains the burning disk cartridge group information, and sends the burning disk cartridge group information to the buffer management module to complete the update of the metadata file;

[0024] When the disk library management module receives a read request, the disk library management module reads the file from the disk cartridge group to the read cache module;

[0025] After receiving the request for creating a cartridge group sent by the management page module, the disk library management module creates a cartridge group and updates the cartridge group information into the cartridge.

[0026] Furthermore, the cache management module is also used to divide the cache module into a pre-read cache module;

[0027] When the mounting module receives the file upload instruction sent by the client, the mounting module creates a corresponding pre-read storage file in the pre-read cache module, and stores the entity data in the pre-read storage file starting from the start position of the entity file until the entity data stored in the pre-read storage file meets the set capacity;

[0028] When the mounting module receives a file download instruction sent by the client, the cache management module sends a read request to the cartridge management module, so that the cartridge management module loads the file from the cartridge group to the read cache module. At the same time, the cache management module reads the entity data in the pre-read storage file at a set speed, and after reading the entity data in the pre-read storage file, starts reading the entity data loaded into the read cache module by the cartridge group from a set position. The set position is a position starting from the starting position of the entity data loaded into the read cache module that is the same as the capacity of the entity data stored in the pre-read storage file.

[0029] Compared with the prior art, the Blu-ray-based file storage system disclosed in the present invention is simpler to use without changing the usage habits of customers. Moreover, the system supports conventional file system interfaces and can be easily mounted on any operating system. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 It is a schematic diagram of the structure of the Blu-ray-based file storage system disclosed in the present invention;

[0031] Figure 2 This is a schematic diagram of cache management of the present invention;

[0032] Figure 3 A flowchart of uploading files disclosed in the present invention;

[0033] Figure 4 A flowchart of burning files disclosed by the present invention;

[0034] Figure 5 A flowchart of downloading files disclosed in the present invention;

[0035] Figure 6 A flow chart of adding a cartridge group disclosed in the present invention;

[0036] Figure 7 The present invention discloses a flowchart for deleting a cartridge group. DETAILED DESCRIPTION

[0037] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0038] like Figure 1 The file storage system based on blue light disclosed in the present invention is shown, comprising:

[0039] Management page module, used to add / delete tray groups through the tray library management module;

[0040] A mounting module, used to mount the cartridge group to the system's cartridge group operation path through a FUSE interface, so that the client can upload and download files from the system's cartridge group operation path;

[0041] a cache management module, used to divide the cache module into a metadata cache module, a write cache module, a burn cache module and a read cache module, and manage the four cache modules; and

[0042] The disk library management module is used for recording files to the disk cartridge group and reading files from the disk cartridge group.

[0043] like Figure 2 As shown, the cache management module is used to divide the cache into metadata cache, write cache, burn cache and read cache;

[0044] The metadata cache is used to store the metadata of the file, and to construct a directory structure of the metadata according to the uploaded directory structure. The metadata of the file also stores the information of the disc tray group on which the file is recorded.

[0045] The write cache is used to save physical files when uploading files, and each disk cartridge group corresponds to a directory file;

[0046] The burning cache is used to store files that need to be burned. When the burning threshold is reached, the cache management module will move the files from the write cache to the burning cache. The burning cache organizes the files according to the size of the disk cartridge.

[0047] The read cache is used to store files that need to be read. The cartridge management module reads the files from the cartridge into the read cache. The files in the read cache have an expiration time and will be deleted by the cache management module after the expiration time.

[0048] The cache management module manages the metadata cache module, the write cache module, the burn cache module and the read cache module, specifically including:

[0049] When the physical data in the write cache management module reaches a certain threshold, the cache management module controls the write cache module to move the physical data to the burn cache module, and after the physical data is moved to the burn cache module, sends a burn request to the disk library management module;

[0050] When the cache management module receives the file burning completion instruction, the cache management module controls the burning cache module to delete the currently burning file, and sends an update instruction to the metadata cache module to update the metadata file;

[0051] When the cache management module receives a file download instruction sent by the client, the cache management module sends a read request instruction to the cartridge management module;

[0052] The cache management module is also used to record the storage time of the read cache file in the read cache module. When the storage time is greater than a certain threshold, the read cache file is determined to be an expired file, and the read cache module is controlled to delete the read cache file.

[0053] The functions implemented by the mounting module include: mounting a file system to the directory of the operating system, file upload and download functions, and file attribute viewing functions;

[0054] The process of mounting the cartridge group to the cartridge group operation path of the system through the FUSE interface and enabling the client to upload and download files from the cartridge group operation path of the system includes the following steps:

[0055] When the mounting module receives the file upload instruction sent by the client, the mounting module creates a metadata file in the metadata cache module and writes the metadata into the metadata file; the mounting module creates an entity file in the write cache module and writes the entity data into the entity file;

[0056] When the mounting module receives the file download instruction sent by the client, the mounting module controls the cache management module to send a file read request to the disk library management module;

[0057] When the mounting module receives the file list request sent by the client, the mounting module traverses the metadata file to obtain a metadata directory list, and sends the metadata directory list to the client.

[0058] The functions implemented by the disk library management module include burning files in the disk to the optical disk cartridge and reading files from the optical disk cartridge to the disk; wherein the process of burning files to the optical disk cartridge and reading files from the optical disk cartridge by the disk library management module includes:

[0059] When the disk library management module receives a burning request, it burns the file in the burning cache module to the disk cartridge group, and after the file burning is completed, it sends a file burning completion instruction to the buffer management module, and simultaneously obtains the burning disk cartridge group information, and sends the burning disk cartridge group information to the buffer management module to complete the update of the metadata file;

[0060] When the disk library management module receives a read request, the disk library management module reads the file from the disk cartridge group to the read cache module;

[0061] After receiving the request for creating a cartridge group sent by the management page module, the disk library management module creates a cartridge group and updates the cartridge group information into the cartridge.

[0062] Furthermore, the cache management module is also used to divide the cache module into a pre-read cache module;

[0063] When the mounting module receives the file upload instruction sent by the client, the mounting module creates a corresponding pre-read storage file in the pre-read cache module, and stores the entity data in the pre-read storage file starting from the start position of the entity file until the entity data stored in the pre-read storage file meets the set capacity;

[0064] When the mounting module receives a file download instruction sent by the client, the cache management module sends a read request to the cartridge management module, so that the cartridge management module loads the file from the cartridge group to the read cache module. At the same time, the cache management module reads the entity data in the pre-read storage file at a set speed, and after reading the entity data in the pre-read storage file, starts reading the entity data loaded into the read cache module by the cartridge group from a set position. The set position is a position starting from the starting position of the entity data loaded into the read cache module that is the same as the capacity of the entity data stored in the pre-read storage file.

[0065] Specifically, when reading a file from a disk cartridge, a process of loading the disk cartridge is required, which takes about two minutes. Two minutes may exceed the waiting time for the client to read the file, thereby causing a reading error on the client.

[0066] The cache management module in the present invention is also used to divide the cache into a pre-read cache module; and to store the entity data in the pre-read storage file starting from the start position of the entity file until the entity data stored in the pre-read storage file meets the set capacity; in this embodiment, when the file is burned to the disk cartridge, the first 1MB of the file is retained and saved in the cache.

[0067] When downloading a file, the cache management module sends a cache (read) request to the cartridge management module, so that the cartridge management module reads the file from the cartridge into the cache. At the same time, the cache management module reads the file in the pre-read storage file at a set speed, and after reading the file in the pre-read storage file, starts reading the file loaded from the cartridge into the cache at a set size. In this embodiment, when the client comes to read, it first sends a cache request to let the cartridge management module read the file from the cartridge into the cache; at the same time, it starts reading from the reserved 1M file, controls the reading speed, and reads only 8KB each time, and then waits for one second. After the size of the file loaded from the cartridge into the cache is greater than 1MB, it starts reading the second half of the file.

[0068] The blue-ray based file storage system disclosed in the present invention can realize functions such as file uploading, file burning, file reading, adding a cartridge group and deleting a cartridge group.

[0069] like Figure 3 The file upload process shown includes the following steps: step ① the client copies the file to the mount path through the system command; step ② the mount module saves the received file metadata to the metadata cache; step ④ the mount module saves the physical file content to the write cache; step ④ the mount module returns the upload result to the client.

[0070] like Figure 4 The process of burning files shown includes the following steps: step ① the cache management module organizes the files to be burned into the burning cache; step ② the cache management module sends the burning request to the disk library management module; step ③ the disk library management module burns the files into the disk cartridge; step ④ the disk library management module sends the burning result to the cache management module; step ⑤ the cache management module updates the disk cartridge information to the metadata of the burned files; step ⑥ the cache management module deletes the burned files in the burning cache.

[0071] like Figure 5 The process of reading files shown includes the following steps: step ① the client copies the file from the mount point; step ② the mount module reads the metadata information of the file from the metadata cache; step ③ the mount module sends a read request to the cache management module; step ④ the cache management module sends a request to the disk library management module; step ⑤ the disk library management module returns the cache result; step ⑥ the cache management module returns the read result to the mount module; step ⑦ the mount module returns the file content to the client.

[0072] like Figure 6 The process of adding a cartridge group shown includes the following steps: Step ① the management page sends a request to the disk library management module; Step ② the disk library management module updates the cartridge group information to the cartridge; Step ③ returns the result of updating the cartridge group; Step ④ the disk library management module returns the result of adding the cartridge group to the management page.

[0073] like Figure 7 The process of deleting a cartridge group shown includes the following steps: Step ① The management page sends a request to the disk library management module; Step ② The disk library management module updates the deletion information of the cartridge group to the cartridge; Step ③ Returns the result of updating the cartridge group; Step ④ The disk library management module returns the result of deleting the cartridge group to the management page.

[0074] The mounting module in the Blu-ray-based file storage system disclosed in the present invention can mount the system on the operating system. After mounting, it becomes a directory of the system, and uploading and downloading can be performed through the mounted directory. The cache management module organizes the data in the write cache into the burning cache and manages the data in the read cache. The disk library management module burns the files in the burning cache into the disk cartridge and reads the files in the disk cartridge into the read cache. The management page provides a disk cartridge management function. This system uses the FUSE interface to implement the file system, and realizes the upload and download of files without changing the user's usage habits, which greatly improves the convenience of using Blu-ray.

[0075] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A file storage system based on Blu-ray, characterized in that: include, Management page module, used to add / delete tray groups through the tray library management module; A mounting module, used for mounting the cartridge group to the cartridge group operation path of the system through the FUSE interface, so that the client can perform file upload and download operations from the cartridge group operation path of the system; a cache management module, used to divide the cache module into a metadata cache module, a write cache module, a burn cache module and a read cache module, and manage the four cache modules; and A disk library management module, used for recording files to the disk cartridge group and reading files from the disk cartridge group; The cache management module is also used to divide the cache module into a pre-read cache module; When the mounting module receives the file upload instruction sent by the client, the mounting module creates a corresponding pre-read storage file in the pre-read cache module, and stores the entity data in the pre-read storage file starting from the start position of the entity file until the entity data stored in the pre-read storage file meets the set capacity; When the mounting module receives a file download instruction sent by the client, the cache management module sends a read request to the cartridge management module, so that the cartridge management module loads the file from the cartridge group to the read cache module. At the same time, the cache management module reads the entity data in the pre-read storage file at a set speed, and after reading the entity data in the pre-read storage file, starts reading the entity data loaded into the read cache module by the cartridge group from a set position. The set position is a position starting from the starting position of the entity data loaded into the read cache module that is the same as the capacity of the entity data stored in the pre-read storage file.

2. The Blu-ray-based file storage system according to claim 1, characterized in that: The process of mounting the cartridge group to the cartridge group operation path of the system through the FUSE interface, and enabling the client to upload and download files from the cartridge group operation path of the system includes the following steps: When the mounting module receives the file upload instruction sent by the client, the mounting module creates a metadata file in the metadata cache module and writes the metadata into the metadata file; The mounting module creates a physical file in the write cache module and writes the physical data into the physical file; When the mounting module receives the file download instruction sent by the client, the mounting module controls the cache management module to send a file read request to the disk library management module; When the mounting module receives the file list request sent by the client, the mounting module traverses the metadata file to obtain a metadata directory list, and sends the metadata directory list to the client.

3. The Blu-ray-based file storage system according to claim 2, characterized in that: The cache management module manages the metadata cache module, the write cache module, the burn cache module and the read cache module, including: When the physical data in the write cache management module reaches a certain threshold, the cache management module controls the write cache module to move the physical data to the burn cache module, and after the physical data is moved to the burn cache module, sends a burn request to the disk library management module; When the cache management module receives the file burning completion instruction, the cache management module controls the burning cache module to delete the currently burning file, and sends an update instruction to the metadata cache module to update the metadata file; When the cache management module receives a file download instruction sent by the client, the cache management module sends a read request instruction to the cartridge management module; The cache management module is also used to record the storage time of the read cache file in the read cache module. When the storage time is greater than a certain threshold, the read cache file is determined to be an expired file, and the read cache module is controlled to delete the read cache file.

4. The Blu-ray-based file storage system according to claim 3, characterized in that: The process of the disk library management module burning files to the disk cartridge and reading files from the disk cartridge includes: When the disk library management module receives a burning request, it burns the file in the burning cache module to the disk cartridge group, and after the file burning is completed, it sends a file burning completion instruction to the buffer management module, and simultaneously obtains the burning disk cartridge group information, and sends the burning disk cartridge group information to the buffer management module to complete the update of the metadata file; When the disk library management module receives a read request, the disk library management module reads the file from the disk cartridge group to the read cache module; After receiving the request for creating a cartridge group sent by the management page module, the disk library management module creates a cartridge group and updates the cartridge group information into the cartridge.

Citation Information

Patent Citations

  • Optical disc juke-box file system and equipment thereof

    CN104217734A

  • Information storage control device and cash control method

    JP2003140938A