Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A distributed file system index method and device based on log merging

A distributed file and file index technology, applied in special data processing applications, instruments, electrical digital data processing, etc., can solve the problems of index omission, low efficiency, and long construction time, so as to solve index omission, avoid loss, reduce The effect of the number of builds

Active Publication Date: 2018-12-11
HANGZHOU EBOYLAMP ELECTRONICS CO LTD
View PDF11 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] The purpose of the present invention is to provide a distributed file system indexing method and device based on log merging to solve the problems of missing indexes, poor client compatibility, inability to incrementally build file indexes, long time-consuming construction, and low efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed file system index method and device based on log merging
  • A distributed file system index method and device based on log merging
  • A distributed file system index method and device based on log merging

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] The technical solution of the present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments, and the following embodiments do not constitute a limitation of the present invention.

[0061] This embodiment provides a distributed file system indexing method based on log merging, such as figure 1 As shown, the log merge-based distributed file system indexing method includes:

[0062] S101. When a file operation occurs, record the file operation information and write it into a log, the file operation information includes the type of file operation and the time when the file operation occurred, and when the type of file operation is a move operation, after recording the file After the operation information is written to the log, the file operation metadata information is created immediately.

[0063] All operation objects in this embodiment can be files or folders unless otherwise specified. For example, "file oper...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed file system index method and device based on log merging. Through the metadata server of the distributed file system, when the logs are merged, the file operationmetadata information is constructed and written into the storage unit, then the operation metadata information in the storage unit is read and parsed, finally, the file index operation is executed, the corresponding index is established, and the processed object is deleted. The invention can solve the problems of missing index, poor compatibility of client end, inability to incrementally build file index, long construction time and low efficiency.

Description

technical field [0001] The invention belongs to the technical field of file storage and processing, and in particular relates to a log merge-based distributed file system indexing method and device. Background technique [0002] With the rapid development of the Internet, cloud computing, big data, and artificial intelligence, according to the forecast of the Internet Data Center (IDC) market research agency, the total amount of global data will grow at a rate of about 50% per year. By 2020, the total amount of global data will The volume will reach 40ZB (1ZB=1 billion TB). Among these data, only about 15% of the data will be frequently accessed, and most of the data will gradually become cold after being generated. Although the access rate of these "cold data" is very low, it still needs to be retained, and for enterprises, there is still a large amount of data that needs to be stored and retrieved. [0003] The journaling file system (Journaling File System) is a file sy...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 张晓宇雷达吴晓晨李昀郑寄平
Owner HANGZHOU EBOYLAMP ELECTRONICS CO LTD
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com