Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data storage method and device

A data storage and data technology, applied in the field of data processing, can solve the problem of low efficiency of large file processing

Inactive Publication Date: 2017-02-15
AGRICULTURAL BANK OF CHINA
View PDF6 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the present invention provides a data storage method and device to solve the problem of low processing efficiency of large files in existing distributed databases on the basis of meeting the storage requirements of a large number of small files

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device
  • Data storage method and device
  • Data storage method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0081] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0082] First of all, it needs to be explained that the existing distributed file management systems are mainly divided into distributed file systems and distributed databases. When a distributed file system stores data, it usually saves file metadata information (such as storage path or offset) in the memory of the main server, and distributes an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data storage method. The method comprises the following steps: receiving data to be processed, and acquiring the data size; when the data size is smaller than a first value, storing the data to a first storage area; when the data size is larger than a second value, storing the data to a second storage area, and storing metadata of the data to the first storage area; and when the data size is larger than or equal to the first value and is smaller than or equal to the second value, according to a preset rule, dividing the data into at least one piece of sub-data, storing each piece of sub-data to a third storage area, and storing metadata of each piece of sub-data to the first storage area according to an arrangement order of the sub-data in the data. The data storage method provided by the embodiment of the invention has the advantages that a distributed file system is combined with a distributed database, so that files with different sizes can be efficiently stored, and the performance of a file storage system is improved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data storage method and device. Background technique [0002] File storage is a relatively common system function at present. Due to the various types of business within the enterprise, a large number of data files of different formats and sizes are generated every day. These data often need to be stored for a long time. Therefore, how to effectively manage these files has become an important topic in the enterprise office system. [0003] At present, it is mainly to use the distributed database related to big data that has emerged in recent years for enterprise-level file management. Distributed databases connect multiple physically dispersed data storage units through a computer network to form a logically unified database, and store files in data storage units in the form of data blocks to obtain greater storage capacity and concurrent visits. Distributed databa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/13G06F16/172G06F16/182G06F16/2282G06F16/27
Inventor 杨全文王仁重王昭岳松颂陈思伟
Owner AGRICULTURAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products