File processing method and device

A file processing and file technology, which is applied in the computer field, can solve problems such as delay and low CPU utilization, and achieve the effect of balancing operation requests and satisfying high concurrency and low latency

Inactive Publication Date: 2016-02-24
SUGON INFORMATION IND
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present application proposes a file processing method and device to solve the technical problems of the samba software in the prior art, such as delays and low CPU utilization in some high-concurrency and low-latency scenarios.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File processing method and device
  • File processing method and device
  • File processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] In order to make the technical solutions and advantages of the present application clearer, the exemplary embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all implementations. Exhaustive list of examples. And in the case of no conflict, the embodiments in this description and the features in the embodiments can be combined with each other.

[0021] The inventor noticed during the invention that:

[0022] Through the analysis of the samba software code, it is found that the main reason lies in the read and write thread model;

[0023] For write operations, multi-threaded writing to the same file introduces race conditions, resulting in a large number of thread switches, which not only increases latency, but also reduces CPU utilization;

[0024] For read operations, multiple threads reading ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a file processing method and device. The file processing method comprises the steps of receiving an operation request sent from a client by a main thread, wherein the operation request comprises operated file IDs; carrying the operation request into the files based on the file IDs in the operation request by the main thread and storing the files in a to-be-processed file queue in sequence; and when files in the to-be-processed file queue need to be processed, obtaining the files from the to-be-processed file queue by a working thread and processing operation requests of the files one by one. As the main thread in the embodiment integrates the operation requests, and operation requests for the same file are integrated together, a race condition of writing operation is excluded through a processing serialization mode for the same files; as pre-reading and magnetic disk bandwidth can be fully utilized, no obvious negative influence to a universal scene can be generated, a performance demand on a high-concurrency and low-delay scene also can be satisfied, and operation requests in the high-concurrency scene can be balanced efficiently.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a file processing method and device. Background technique [0002] Network Attached Storage (NAS, NetworkAttachedStorage) technology is a mature, efficient, and low-cost storage technology that usually includes storage devices, system software, and file sharing services. Samba is an open source software that provides file sharing services based on the ServerMessageBlock (SMB) protocol. As a mature open source software, samba satisfies the needs of most application scenarios well. However, for some high-concurrency and low-latency scenarios, samba's performance is not satisfactory, often causing delays and low CPU utilization. and so on. [0003] The deficiencies in the prior art are: [0004] The existing samba software often has delays and low CPU utilization in some high-concurrency and low-latency scenarios. Contents of the invention [0005] The embodiment o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/067
Inventor 王喆郑劭馨付根希杨浩苗艳超惠润海
Owner SUGON INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products