Method, system and memory for improving read-write throughput capacity of file storage NAS

A throughput and file storage technology, applied in the direction of instruments, special data processing applications, inter-program communication, etc., can solve the problem of increased read and write latency of file storage NAS, improve read and write throughput, improve write performance, The effect of tenant isolation

Active Publication Date: 2021-10-08
JIANGSU SECURITIES
View PDF15 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In order to overcome the above-mentioned deficiencies in the prior art, the present invention provides a method, system and memory for improving the read and write throughput of file storage NAS, which solves the problem of increased read and write delays of file storage NAS in high concurrency scenarios, and even sporadic The problem of write failure has greatly improved the read and write throughput of file storage NAS

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, system and memory for improving read-write throughput capacity of file storage NAS
  • Method, system and memory for improving read-write throughput capacity of file storage NAS
  • Method, system and memory for improving read-write throughput capacity of file storage NAS

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0066] figure 1 It is a schematic flowchart of an implementation method for uploading and writing according to an embodiment of the present invention; figure 1 As shown, the method for uploading and writing in this embodiment includes steps S101-S112.

[0067] In step S101, the upload request sent by the user through the browser or mobile phone APP is acquired, and the request content includes system identification and file information.

[0068] Specifically, the system identification includes the name of the file, the type of the file, and the starting time (year, month, day, hour, minute, second, millimeter) of the uploading of the file.

[0069] In step S102, the system in the user request generates the path to be written into the NAS and the unique file identification ID.

[0070] Specifically, the system identification in the user upload request is screened and deleted first, and a unique file identification ID and a path to be written to the NAS are generated according...

Embodiment 2

[0086] In one embodiment, such as figure 2 As shown, S201-S203 are schematic flowcharts of the implementation method of asynchronous program reading according to this embodiment.

[0087] In step S201, start an additional asynchronous program to read the message in the message middleware, write the content of the file into the NAS, and write the metadata into the database. After both the content of the file and the metadata are successfully written, In step S202, the identification ID of the file in the queue to be processed in the distributed cache is deleted.

[0088] Specifically, if writing a message fails in the asynchronous program, an alarm message is returned to the maintenance personnel, and the cause of the failure is analyzed.

[0089] Specifically, the asynchronous program reads the message in the message middleware, writes the content of the file into the NAS, and writes the metadata into the database, then judges the size of the queue set to be processed in the...

Embodiment 3

[0091] In one embodiment, such as image 3 As shown, S301-S is a schematic flowchart of a method for implementing user downloading according to this embodiment.

[0092] In step S301, a user download request is obtained.

[0093] In step S302, read the file metadata information and file content directly from the distributed cache according to the file identification ID, if the reading is successful, in step S303, read the file content corresponding to the file identification ID from the distributed cache, In step S306, update the file identification ID metadata information in the distributed cache, and return the file stream in step S304.

[0094] Specifically, in step S302, if reading the file metadata information from the distributed cache according to the file ID fails, then in step S305, query the file ID information from the database, and update the static ID in the distributed cache in step S306. ID metadata information.

[0095] Specifically, in S303, if reading the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method, a system and a memory for improving the read-write throughput capacity of a file storage NAS (Network Attached Storage). The method comprises the following steps: acquiring an upload request of a user, and generating a path to be written into the NAS and a unique file identifier ID through a system identifier; reading a file stream; judging the size of the file information, and if the size of the file information is within a set range, writing the file information into a distributed cache by taking a file identifier ID as a main key; setting the expiration time of the file identifier ID in the distributed cache by taking the file identifier ID as a main key; setting a queue to be processed in the distributed cache, and placing a file identifier ID in the queue; and after serializing the format of the file identifier ID, the path to be written into the NAS and the specific file stream, writing the file identifier ID, the path to be written into the NAS and the specific file stream into the message middleware, and finally returning a response to the user. The problems of increase of read-write delay of the NAS and accidental writing failure in a high-concurrency scene are solved, and the read-write throughput capacity of the NAS is greatly improved.

Description

technical field [0001] The invention relates to the technical field of distributed network storage, in particular to a method, system and memory for improving the read and write throughput of file storage NAS. Background technique [0002] NAS (Network Attached Storage) is a distributed network storage technology. It takes data as the center, separates storage devices from servers, centralizes data management, and greatly reduces costs. [0003] NAS consists of storage devices, operating systems, and file systems. NAS is directly connected to the disk storage array through the network, and exposes the storage device through the standard network topology and its own dedicated operating system for data storage to provide services. It uses a specialized operating system for network file access, supports NFS, CIFS, FTP, HTTP and other protocols, and can meet standard file access and other specific network protocols. [0004] The throughput of NAS itself is weak. In a high-co...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F16/172G06F9/54
CPCG06F16/172G06F16/1824G06F9/546G06F2209/547
Inventor 谷正亮
Owner JIANGSU SECURITIES
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap