Unlock instant, AI-driven research and patent intelligence for your innovation.

FICS object storage-based file merging method and system

A technology for object storage and file storage, which is applied in file systems, file access structures, special data processing applications, etc. It can solve the problems of wasting time and resources, large disk space, and consumption of tens of minutes or even hours, and achieve saving Occupies space and improves speed

Inactive Publication Date: 2016-11-09
CHENGDU SOBEY DIGITAL TECH CO LTD
View PDF2 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] File merging, that is, the data content of multiple files is merged into a new file. On the storage of the current local file system and other distributed file systems, etc., the data of all source files needs to be read out in sequence and written into to a new file; if the source file is a large file, then this is very time-consuming. For example, if the source file is hundreds of gigabytes in size, it may consume tens of minutes or even hours
At the same time, it will consume a lot of storage read and write bandwidth
Moreover, although most of the data content of the source file and the target file are the same, the actual occupied disk space is still relatively large, which is the sum of the data size of the files used; the existing file merging method is a waste of time and resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • FICS object storage-based file merging method and system
  • FICS object storage-based file merging method and system
  • FICS object storage-based file merging method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The technical solution of the present invention will be further described in detail below in conjunction with the accompanying drawings, but the protection scope of the present invention is not limited to the following description.

[0040] Such as figure 1 As shown, a method for merging files based on FICS object storage includes the following steps:

[0041] S1. File storage: save each data of the file to be stored, and generate a file address for the file to be stored;

[0042] S2. File merging: given the files to be merged, file merging is realized by processing file addresses.

[0043] Such as figure 2 As shown, the step S1 includes the following sub-steps:

[0044] S11. Input each file to be stored in turn;

[0045] S12. Divide the current file to be stored into a plurality of data;

[0046] S13. Save each data;

[0047] S14. Generate a data address for each data, the data address includes the data storage location, the offset of the data in the file and th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an FICS object storage-based file merging method and system. The method comprises the following steps of: S1, file storage: storing each data of a to-be-stored file and generating a file address for the to-be-stored file; and S2, file merging: giving a to-be-merged file and a merging sequence, and realizing file merging through processing the file address. The system comprises an FICS object storage module and a file merging module. According to the FICS object storage-based file merging method and system provided by the invention, each data of the file is stored in the storage process, the file address is generated for the file, and the file merging is realized through processing the file address, so that the file merging speed is improved and the space occupation of the file merging is saved.

Description

technical field [0001] The invention relates to a file merging method and system based on FICS object storage. Background technique [0002] File merging, that is, the data content of multiple files is merged into a new file. On the storage of the current local file system and other distributed file systems, etc., the data of all source files needs to be read out in sequence and written into to a new file; if the source file is a large file, then this is very time-consuming. For example, if the source file is hundreds of gigabytes in size, then it may consume tens of minutes or even hours. At the same time, it will also consume a large amount of storage read and write bandwidth. Moreover, although most of the data content of the source file and the target file are the same, the actual occupied disk space is still relatively large, which is the sum of the data size of the files used; the existing file merging method is a waste of time and resources . Contents of the inven...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/182G06F16/13
Inventor 李科余军韩志宏
Owner CHENGDU SOBEY DIGITAL TECH CO LTD