Unlock instant, AI-driven research and patent intelligence for your innovation.

Method for quickly splitting and merging file on basis of restructured file metadata

A file metadata and file technology, applied in file systems, electronic digital data processing, special data processing applications, etc., to achieve the effect of eliminating I/O operations, eliminating copy overhead, and improving performance

Active Publication Date: 2014-10-01
BEIJING LOONGSTORE TECH
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0016] In fact, in the face of the above-mentioned complex operation process, on the one hand, it brings a lot of I / O overhead (I / O overhead refers to: the percentage of input and output traffic), on the other hand, it has a huge overhead on the entire application of this type, thus making the process a bottleneck point in the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for quickly splitting and merging file on basis of restructured file metadata
  • Method for quickly splitting and merging file on basis of restructured file metadata

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0080] Embodiment 1: In a certain large video file, clip two video clips with a size of 2GB from a 10GB video file File1 without changing the original video file File1, one is the part of 0-2GB in the source file File2, the other is a 4-6GB partial File3 from the source file.

[0081] Use SplitFile(File2, File1, FALSE, 0, 2GB) to generate File2, and then call SplitFile(File3, File1, FALSE, 4GB, 2GB) to generate File3. Through such an operation, the cutting performance is greatly improved, and the things that originally took several minutes to complete can be completed in one second.

Embodiment 2

[0082] Embodiment 2: there are two video files File1 and File2, need to synthesize a video file File3 and do not change the video files File1 and File2;

[0083] Just use MergeFile(File3, FALSE, File1, File2) directly.

Embodiment 3

[0084] Embodiment 3: There are two video files File1 and File2 with a size of 10GB, and a video file File3 needs to be edited and synthesized. The video file File3 has a size of 6GB, wherein the front 2GB comes from 0-2GB of File1, and the back 4GB comes from 0 of File2 -4GB, it is required to keep the original File1 and File2 unchanged after modification;

[0085] 1. Use SplitFile(subFile1, File1, FALSE, 0, 2GB) to generate subFile1;

[0086] 2. Use SplitFile(subFile2, File2, FALSE, 0, 4GB) to generate subFile2;

[0087] 3. Use MergeFile(File3, TRUE, subFile1, subFile2) to generate File3.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for quickly splitting and merging a file on the basis of restructured file metadata. The method includes the steps that original POSIX file operation interfaces namely newly added file splitting and merging interfaces are extended, the two extension interfaces interact with an inner core of an operation system in an IOCTL mode, and work procedures of the Split File interface and work procedures of the Merge File interface are carried out. Convenience is brought to applications needing file splitting and merging, coping cost in the file splitting and merging processes is eliminated, the method is very effective to a distributive file system, a large quantity of I / O operations are eliminated and performance of the applications such as file splitting and merging is substantially improved.

Description

technical field [0001] The invention relates to a method for file cutting and merging, in particular to a method for realizing fast file cutting and merging based on reorganized file metadata, and belongs to the technical field of distributed file systems and network storage systems. Background technique [0002] In a traditional distributed file system or a local file system, file cutting and merging are all implemented by data copying. Some existing file merging and cutting software are essentially implemented by copying data. The only difference is the use of multi-threading technology, but this does not essentially solve the problem of low efficiency of merging and cutting. [0003] For example, when the user only needs part of the contents of a file, the following file system operations are actually required: [0004] 1. Open the source file; [0005] 2. Create a new file; [0006] 3. Read the required content in the source file and write it into the new file; [00...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/10
Inventor 丁亚军
Owner BEIJING LOONGSTORE TECH