File system, file storage method, storage device and computer readable medium

A file system and file storage technology, applied in the computer field, can solve the problems of saving and backing up a lot of time, reducing file processing speed, etc., and achieve the effect of increasing speed and alleviating memory pressure

Inactive Publication Date: 2019-06-28
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

HDFS does not exist to effectively process a large number of small files, but is designed for streaming access to large files. If a large number of small files are stored at the same time, HDFS will spend a lot of time saving and backing up metadata. It will put pressure on Namenode's memory, and the speed of file processing will be greatly reduced

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File system, file storage method, storage device and computer readable medium
  • File system, file storage method, storage device and computer readable medium
  • File system, file storage method, storage device and computer readable medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. It should be understood, however, that these descriptions are exemplary only, and are not intended to limit the scope of the present disclosure. Also, in the following description, descriptions of well-known structures and techniques are omitted to avoid unnecessarily obscuring the concept of the present disclosure.

[0035] The terminology used herein is for the purpose of describing particular embodiments only, and is not intended to be limiting of the present disclosure. The words "a", "an" and "the" used herein shall also include the meanings of "plurality" and "multiple", unless the context clearly indicates otherwise. In addition, the terms "comprising", "comprising", etc. used herein indicate the existence of stated features, operations, operations and / or components, but do not exclude the existence or addition of one or more other features, operations, operation...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a file system, a file storage method of the file system, a file storage device of the file system and a computer readable medium. In the file storage method of the file system,at least two levels of indexes are used in the file system, a relation between a category of a file to be stored and block information of the file system is stored in a first level of index in the atleast two levels of indexes, and the file storage method of the file system comprises the following operations: obtaining the category according to the category information; Segmenting the file into aplurality of segments; Querying and obtaining block information associated with the category in the first-level index according to the category information; Under the condition that the correspondingblock has no residual space or the size of the residual space is smaller than that of the fragment, inserting a relation between a continuous extension category representing the same category as thecategory of the file and new block information into the first-level index, and storing the fragment in the block when the size of the fragment is greater than or equal to that of the fragment; And storing the relationship between the block information and the information of the file in other indexes except the first-level index in the at least two levels of indexes.

Description

technical field [0001] The present disclosure relates to the field of computer technology, and more specifically, to a file system, a file storage method for the file system, a file storage device for the file system, and a computer-readable medium. Background technique [0002] With the advent of the era of big data, data is exploding in an unprecedented way, and the heterogeneity of data is becoming stronger and stronger. The storage and processing of massive heterogeneous data has brought us more and more challenges. Distributed file system (Hadoop Distributed File System, HDFS) is used by many large enterprises to process massive data because of its good stability and high efficiency. [0003] However, it still has some limitations of its own, among which the problem of small files seriously restricts the further development of HDFS. [0004] Block is the most basic storage unit of HDFS. The default size of block is 64M (it can also be set to 128M). It will not occupy ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/13G06F16/182G06F3/06
Inventor 朱媛媛
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap