Method for quickly splitting and merging file on basis of restructured file metadata
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
A file metadata and file technology, applied in file systems, electronic digital data processing, special data processing applications, etc., to achieve the effect of eliminating I/O operations, eliminating copy overhead, and improving performance
Active Publication Date: 2014-10-01
BEIJING LOONGSTORE TECH
View PDF6 Cites 5 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
[0016] In fact, in the face of the above-mentioned complex operation process, on the one hand, it brings a lot of I / O overhead (I / O overhead refers to: the percentage of input and output traffic), on the other hand, it has a huge overhead on the entire application of this type, thus making the process a bottleneck point in the system
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0080] Embodiment 1: In a certain large video file, clip two video clips with a size of 2GB from a 10GB video file File1 without changing the original video file File1, one is the part of 0-2GB in the source file File2, the other is a 4-6GB partial File3 from the source file.
[0081] Use SplitFile(File2, File1, FALSE, 0, 2GB) to generate File2, and then call SplitFile(File3, File1, FALSE, 4GB, 2GB) to generate File3. Through such an operation, the cutting performance is greatly improved, and the things that originally took several minutes to complete can be completed in one second.
Embodiment 2
[0082] Embodiment 2: there are two video files File1 and File2, need to synthesize a video file File3 and do not change the video files File1 and File2;
[0083] Just use MergeFile(File3, FALSE, File1, File2) directly.
Embodiment 3
[0084] Embodiment 3: There are two video files File1 and File2 with a size of 10GB, and a video file File3 needs to be edited and synthesized. The video file File3 has a size of 6GB, wherein the front 2GB comes from 0-2GB of File1, and the back 4GB comes from 0 of File2 -4GB, it is required to keep the original File1 and File2 unchanged after modification;
[0085] 1. Use SplitFile(subFile1, File1, FALSE, 0, 2GB) to generate subFile1;
[0086] 2. Use SplitFile(subFile2, File2, FALSE, 0, 4GB) to generate subFile2;
[0087] 3. Use MergeFile(File3, TRUE, subFile1, subFile2) to generate File3.
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
PUM
Login to view more
Abstract
The invention discloses a method for quickly splitting and merging a file on the basis of restructured file metadata. The method includes the steps that original POSIX file operation interfaces namely newly added file splitting and merging interfaces are extended, the two extension interfaces interact with an inner core of an operation system in an IOCTL mode, and work procedures of the Split File interface and work procedures of the Merge File interface are carried out. Convenience is brought to applications needing file splitting and merging, coping cost in the file splitting and merging processes is eliminated, the method is very effective to a distributive file system, a large quantity of I/O operations are eliminated and performance of the applications such as file splitting and merging is substantially improved.
Description
technical field [0001] The invention relates to a method for file cutting and merging, in particular to a method for realizing fast file cutting and merging based on reorganized file metadata, and belongs to the technical field of distributed file systems and network storage systems. Background technique [0002] In a traditional distributed file system or a local file system, file cutting and merging are all implemented by data copying. Some existing file merging and cutting software are essentially implemented by copying data. The only difference is the use of multi-threading technology, but this does not essentially solve the problem of low efficiency of merging and cutting. [0003] For example, when the user only needs part of the contents of a file, the following file system operations are actually required: [0004] 1. Open the source file; [0005] 2. Create a new file; [0006] 3. Read the required content in the source file and write it into the new file; [00...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to view more 
Login to view more