Unlock instant, AI-driven research and patent intelligence for your innovation.

Distributed storage method of mass data

A distributed storage and mass data technology, applied in the field of data storage, can solve problems such as crowding together, data confusion, and inconvenient access to stored files

Active Publication Date: 2016-03-23
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the prior art, the storage process of massive data is usually extensive storage, that is, without processing, the data files are stored sequentially according to the time sequence of the received data files, which obviously leads to Different types of data are jumbled together, causing serious inconvenience to subsequent access to stored files

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage method of mass data
  • Distributed storage method of mass data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0037] The embodiment of the present invention discloses a distributed storage method for massive data, see figure 1 As shown, the above distributed storage methods include:

[0038] Step S11: when the input file is obtained, split the input file to obtain N block files accordingly, where N is a positive integer;

[0039] Step S12: performing feature information extraction processing on each of the above-mentioned N block files respectively, and corresponding...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed storage method of mass data. The method comprises the following steps of when an input file is acquired, segmenting the input file, and correspondingly obtaining N block files; respectively executing characteristic information extraction treatment to each block file, and correspondingly obtaining characteristic information of each block file; sorting the block files, which have identical characteristic information, of the N block files in one type, and correspondingly obtaining M types of files; respectively executing file merging for each type of files, correspondingly obtaining M merged files, and storing the M merged files. In the method provided by the invention, firstly, the input file is segmented after the input file is received, characteristic information of a plurality of block files obtained by segmentation is extracted, then, the block files having identical characteristic information are sorted in on type, and the files of each type are merged and stored, thus, mining for the characteristic information of the plurality of block files is realized, and rational and efficient storage of data is realized.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a distributed storage method for massive data. Background technique [0002] Currently, with the development of network applications, data resources in the network continue to expand. On the one hand, the database server needs to solve the problems of storage space and access speed, and on the other hand, it also needs to consider the mining and processing of massive data to achieve reasonable and efficient storage of massive data. [0003] However, in the prior art, the storage process of massive data is usually extensive storage, that is, without processing, the data files are stored sequentially according to the time sequence of the received data files, which obviously leads to Different types of data are jumbled together, making subsequent access to stored files severely inconvenient. [0004] To sum up, it can be seen that how to mine data in advance before data stora...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08G06F17/30
CPCG06F16/182H04L67/1097
Inventor 李傲
Owner INSPUR BEIJING ELECTRONICS INFORMATION IND
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com