Processing method, system, device and medium for file reading and writing business

A processing method and file technology, applied in the storage field, can solve problems such as system load, increase read and write IO delay, etc., and achieve the effect of reducing processing pressure and frequency, and reducing file read and write delay.

Active Publication Date: 2021-10-29
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] For the distributed file system (object storage), when the HDFS protocol is accessed, because it is a stateless access (the client will not send open and close requests to the storage end like the standard posix protocol), the distributed file system receives and reads each time When requesting, you need to open the file handle to realize the read and write business, and then close the file handle after completion, which will cause a large number of open and close file handle requests, cause a lot of load on the system, and increase the delay of each read and write IO

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Processing method, system, device and medium for file reading and writing business
  • Processing method, system, device and medium for file reading and writing business
  • Processing method, system, device and medium for file reading and writing business

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0050] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are to distinguish two entities with the same name but different parameters or parameters that are not the same, see "first" and "second" It is only for the convenience of expression, and should not be construed as a limitation on the embodiments of the present invention, which will not be described one by one in the subsequent embodiments.

[0051] According to one aspect of the present invention, an embodiment of the present invention proposes a processing method for file reading and writing services, such as figure 1 As shown, it may include the steps of:

[0052] S1, in response to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a processing method for file reading and writing services, comprising the following steps: in response to receiving the file reading and writing services, judging whether there is a cache handle of the file in the index container according to the serial number of the file; in response to the absence of the file in the index container Open the corresponding handle of the file according to the read and write business; encapsulate the flag and pointer of the corresponding handle and the file serial number to obtain the cache handle of the file; add the cache handle of the file to the index container and the first queue; use the file The corresponding handle of the file is used to process the read and write business; in response to the completion of the read and write business processing, the cache handle of the file is moved from the first queue to the second queue. The invention also discloses a system, computer equipment and readable storage medium. The solution proposed by the embodiment of the present invention effectively reduces the pressure and frequency of file handle processing when the distributed file system reads and writes.

Description

technical field [0001] The invention relates to the field of storage, in particular to a processing method, system, device and storage medium for file reading and writing services. Background technique [0002] For the distributed file system (object storage), when the HDFS protocol is accessed, because it is a stateless access (the client will not send open and close requests to the storage end like the standard posix protocol), the distributed file system receives and reads each time When requesting, the file handle needs to be opened to realize the read and write business, and then the file handle is closed after completion. This will cause a large number of requests to open and close the file handle, which will cause a lot of load on the system and increase the delay of each read and write IO. Contents of the invention [0003] In view of this, in order to overcome at least one aspect of the above problems, an embodiment of the present invention proposes a method for p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06G06F16/13G06F16/172G06F16/182
CPCG06F3/0611G06F3/0643G06F3/067G06F16/13G06F16/172G06F16/182
Inventor 王帅阳李文鹏李旭东
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products