Check patentability & draft patents in minutes with Patsnap Eureka AI!

Mass file integration storage method and system supporting asynchronous submission

A technology for file storage and mass files, which is applied in the direction of file system, file system function, file/folder operation, etc. It can solve the problems of low storage efficiency of concurrently submitted files, low efficiency of deletion, and delay of data submission

Active Publication Date: 2021-06-04
山东兆物网络技术股份有限公司
View PDF14 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, commonly used business systems submit files to the file storage system in a synchronous manner, return the assigned file ID information to fill in the data record, and then submit the data record. Using the synchronous file submission method, the storage efficiency of concurrently submitted files is not high, and it causes delays in data submission, which cannot achieve the purpose of real-time retrieval
[0003]Some file storage systems do not integrate and store small files, and a large number of small files are stored scattered, resulting in serious waste of disk space and high disk IO, which will exceed the file handle of the operating system maximum limit
[0004]And some file storage systems have integrated storage for small files, but the same strategy has been adopted for large files, resulting in low efficiency in file access and deletion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mass file integration storage method and system supporting asynchronous submission
  • Mass file integration storage method and system supporting asynchronous submission
  • Mass file integration storage method and system supporting asynchronous submission

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0059] Such as Figure 1 to Figure 8 As shown, through the unified left and right external interfaces of the cluster access management node, the file storage node receives, writes, deletes, reads and cleans files through the cluster access management node, including the following steps:

[0060] S1: File reception: the cluster access management node receives the file submitted by the business system, performs corresponding processing according to the submission mode, allocates the corresponding file storage node, and returns the allocated storage information to the business system;

[0061] S2: File storage: determine whether the file to be stored is a large file or a small file, calculate the corresponding storage path, and store the file;

[0062] S3: File reading: Receive and read file request information, find the corresponding file storage node, and read the corresponding file;

[0063] S4: File deletion: receive a request to delete a file, find the corresponding file st...

Embodiment 2

[0098] A mass file integrated storage system supporting asynchronous submission, comprising a cluster access management node and several file storage nodes connected to the cluster access management node, the cluster access management node connected to several business systems;

[0099] The cluster access management node is responsible for functions such as management of the entire file storage cluster, status monitoring, unified external interface call of files, path allocation and routing of file storage nodes, and includes a cluster management module, a file receiving agent module, and a file access agent module , file deletion proxy module, file storage node routing module;

[0100] The file storage node is responsible for the storage of files, providing functions such as file storage to interface calls, node management, status monitoring, etc., including node management module, file receiving module, file writing module, file deleting module, file reading module, file clea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of network file storage, in particular to a mass file integration storage method and system supporting asynchronous submission. The mass file integration storage method supporting asynchronous submission comprises the following steps: S1, file receiving; s2, file storage; s3, file reading; s4, file deleting; and S5, file clearing. According to the mass file integration storage method and system supporting asynchronous submission, delayed storage of synchronously submitted data is avoided, the utilization rate of the storage space is high, and the file access deletion efficiency is high.

Description

technical field [0001] The invention relates to the technical field of network file storage, in particular to a massive file integrated storage method and system supporting asynchronous submission. Background technique [0002] At present, commonly used business systems submit files to the file storage system in a synchronous manner, return the assigned file ID information to fill in the data record, and then submit the data record, using the synchronous file submission method, the efficiency of concurrent file storage is not high, and The data submission is delayed and the purpose of real-time retrieval cannot be achieved. [0003] Some file storage systems do not integrate and store small files, and a large number of small files are stored scattered, resulting in serious waste of disk space and high disk IO, which will exceed the maximum number of file handles in the operating system. [0004] While some file storage systems integrate and store small files, the same strat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/182G06F16/16G06F16/17
CPCG06F16/182G06F16/162G06F16/17
Inventor 郝振石杨朝敬马宁
Owner 山东兆物网络技术股份有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More