File processing method and device, equipment and medium

A file processing and processing device technology, applied in file system management, file system, electronic digital data processing and other directions, can solve the problems of high data transmission overhead, affecting system performance, waste of disk space, etc., to reduce transmission overhead and data. amount of effect

Active Publication Date: 2021-03-12
ZHEJIANG UNIVIEW TECH CO LTD
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in an actual distributed storage system, there will be many empty files
When it is necessary to restore the data of these empty files, if the original repair process is followed, "0" data will be written when copying these empty files, which will occupy disk space and cause disk space waste
Moreover, when repai

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File processing method and device, equipment and medium
  • File processing method and device, equipment and medium
  • File processing method and device, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, only some structures related to the present invention are shown in the drawings but not all structures.

[0035] Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe various operations (or steps) as sequential processing, many of the operations (or steps) may be performed in parallel, concurrently, or simultaneously. In addition, the order of operations can be rearranged. The process may be terminated when its operations are complete, but may also have additional...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a file processing method and device, equipment and a medium. The method comprises the steps of reading to-be-processed data from a to-be-processed file, wherein a value of a file cavity in the to-be-processed data is a preset numerical value; if the values of the to-be-processed data are all the preset values, deleting the to-be-processed data from the to-be-processed file to obtain a new to-be-processed file; comparing the disk usage amount of the to-be-processed file with the disk usage amount of the new to-be-processed file, and repairing the file according to a comparison result. By adopting the scheme of the embodiment, the file hole of the to-be-processed file can be deleted as much as possible through the comparison result, so when the to-be-processed file needs to be repaired, the reserved data is directly used for repairing, and the file hole does not need to be filled with a large amount of '0' data when the data is written; therefore, the data volume during file repair is reduced, and the transmission overhead of remote transmission data during file repair between nodes in the distributed storage system is reduced.

Description

technical field [0001] Embodiments of the present invention relate to the field of distributed storage technologies, and in particular, to a file processing method, device, equipment, and medium. Background technique [0002] In a distributed storage system, when data on a certain node is lost, it is usually necessary to restore the lost data by reading data on other nodes to ensure data reliability. [0003] However, in an actual distributed storage system, there will be many empty files. When it is necessary to perform data repair on these empty files, if the original repair process is followed, "0" data will be written when copying these empty files, thus occupying disk space and causing disk space waste. Moreover, when repairing an abnormally large hole file, since it is necessary to fill a large number of "0" data in the hole file, it will increase the repair time and affect system performance; at the same time, filling a large amount of "0" data will result in a very ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/16G06F16/11G06F16/182
CPCG06F16/16G06F16/162G06F16/113G06F16/182
Inventor 江萍石岩梁红伟
Owner ZHEJIANG UNIVIEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap