Distributed file storage method and system, medium and computing equipment

A technology for file storage and storage media, applied in the computer field, can solve the problems of slowing down the speed of storing files and occupying memory resources, etc., and achieve the effect of increasing the speed and simplifying the storage process

Pending Publication Date: 2022-05-03
全程(上海)智能科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in practice, it is found that a large number of small files will appear in the process of storing files

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed file storage method and system, medium and computing equipment
  • Distributed file storage method and system, medium and computing equipment
  • Distributed file storage method and system, medium and computing equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The principle and spirit of the present invention will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are given only to enable those skilled in the art to better understand and implement the present invention, rather than to limit the scope of the present invention in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

[0028] Those skilled in the art know that the embodiments of the present invention can be implemented as a system, device, device, method or computer program product. Therefore, the present invention can be implemented in the form of complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0029] According to an embodiment of the present invention, a distributed-based file stor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a distributed file storage method and system, a medium and computing equipment. The method comprises the following steps: storing a to-be-stored data file to the tail of a data storage file matched with the to-be-stored data file; extracting the to-be-stored data file to obtain a to-be-stored metadata file corresponding to the to-be-stored data file; and storing the to-be-stored metadata file to the tail part of a metadata storage file matched with the to-be-stored metadata file. The method is applied to the column type file storage system, on the basis of the column type file storage system, additional storage can be carried out on the to-be-stored data files/to-be-stored metadata files with the small volume based on the column type file storage system, a large number of small files with the smaller volume cannot occur in the process, and the storage efficiency is improved. Therefore, a large number of small files do not need to be stored, the storage process of the column type file storage system is simplified, and the speed of accessing the storage file in the column type file storage system is increased.

Description

technical field [0001] Embodiments of the present invention relate to the field of computer technology, and more specifically, embodiments of the present invention relate to a distributed-based file storage method, system, medium, and computing device. Background technique [0002] This section is intended to provide a background or context for implementations of the invention that are recited in the claims. The descriptions herein are not admitted to be prior art by inclusion in this section. [0003] With the advancement of science and technology, all walks of life have begun to transform to informatization, and the total amount of data is growing exponentially. Facing the big explosion of data, distributed storage has become an inevitable choice for modern information storage. At present, in the field of distributed file storage technology represented by Hadoop Distributed File System (Hadoop Distributed File System, HDFS), HDFS is widely used to efficiently process var...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/182G06F16/13
CPCG06F16/182G06F16/13
Inventor 李志鹏韩世思王继军方亮徐旭辉刘炜
Owner 全程(上海)智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products