Distributed storage method and device, computer equipment and storage medium

A distributed storage and storage node technology, applied in the field of data storage, can solve the problems of unencrypted data, unstable storage nodes, and easy loss, so as to improve privacy and security, avoid restoring original files, and reduce bandwidth costs Effect

Active Publication Date: 2018-10-16
BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
View PDF9 Cites 40 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

With more and more stored data, the server storage space and bandwidth resources are seriously occupied, and the cost of cloud storage continues to increase
Moreover, the existing cloud storage technology stores data in the cloud without encryption, and the privacy of data is endorsed by the credit of large cloud storage service providers
[0003] If distributed storage technology is adopted, due to the decentralized storage of data, the credit will be decentralized, which will lead to the problem of insecure data storage caused by unstable storage nodes, which are easy to be lost and vulnerable to attacks.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage method and device, computer equipment and storage medium
  • Distributed storage method and device, computer equipment and storage medium
  • Distributed storage method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034] figure 1 It is a flowchart of a distributed storage method provided by Embodiment 1 of the present invention. This embodiment is applicable to the situation of storing files in a distributed network. The method can be executed by a distributed storage device, which can be implemented by software and / or hardware, and generally can be integrated in any computer device that needs to initiate data storage, such as figure 1 As shown, the method includes the following operations:

[0035] S110. Group the files to be stored into groups to form multiple data groups.

[0036] Wherein, the file to be stored may be text, picture, video, audio, and other types of storable files (such as compressed files in zip format, etc.), and the embodiment of the present invention does not limit the type of the file to be stored. The data packet may be part of the file data of the file to be stored.

[0037] In the embodiment of the present invention, before distributed storage of the files ...

Embodiment 2

[0054] Figure 2a It is a flow chart of a distributed storage method provided by Embodiment 2 of the present invention. This embodiment is embodied on the basis of the foregoing embodiments. In this embodiment, an implementation manner of encrypting data packets is given. At the same time, the corresponding relationship between data fragments and data packets, and the corresponding relationship between storage nodes and stored data fragments will be recorded as follows: the hash value of the data packets included in the data fragments is recorded in the form of a Merkle tree, As a fragmented Merkle tree; recording the correspondence between each fragmented Merkle tree and the storage node where each said data fragment is located. Correspondingly, such as Figure 2a As shown, the method of this embodiment may include:

[0055] S210. Group the files to be stored to form multiple data groups.

[0056] S220. Encrypt each data packet sequentially using a key, wherein the key of ...

Embodiment 3

[0072] Figure 3a It is a flowchart of a distributed storage method provided in Embodiment 3 of the present invention, Figure 3b It is a flowchart of a method for recovering stored files in a distributed storage method provided by Embodiment 3 of the present invention. This embodiment is embodied on the basis of the above-mentioned embodiments. The specific implementation of forming storage files, correspondingly, such as Figure 3a As shown, the method of the embodiment of the present invention may include:

[0073] S310. Group the files to be stored to form multiple data groups.

[0074] S320. Form all data packets into at least three data fragments, wherein each data fragment includes some data packets, and each data packet is added to at least two data fragments.

[0075] S330. Perform distributed storage of each piece of data in the distributed storage nodes.

[0076] S340. Record the correspondence between data slices and data packets, and the correspondence between...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a distributed storage method and device, computer equipment and a storage medium. The method comprises the steps of grouping a to-be-stored file to form multiple data groups; forming at least three data fragments from all the data groups, wherein each data fragment comprises part of data groups, and each data group is added to at least two data fragments;distributedly storing all the data fragments in distributed storage nodes; recording a corresponding relationship between the data fragments and the data groups, and a corresponding relationship between the storage nodes and the stored data fragments; deleting the local to-be-stored file. According to the technical scheme, a user conveniently stores files in a distributed network to lower the storage cost, the privacy and safety of the stored files can be effectively improved, and thus an attacker is prevented from restoring original files.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of data storage, and in particular, to a distributed storage method, device, computer equipment, and storage medium. Background technique [0002] The cloud storage technology in the prior art is generally stored through a centralized server. With more and more stored data, the server storage space and bandwidth resources are seriously occupied, and the cost of cloud storage continues to increase. Moreover, the existing cloud storage technology stores data in the cloud without encryption, and the privacy of the data is endorsed by the credit of large cloud storage service providers. [0003] If distributed storage technology is adopted, due to the decentralized storage of data, the credit will be decentralized, which will lead to the problem of insecure data storage caused by unstable storage nodes, which are easy to lose and vulnerable to attack. Contents of the invention [00...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/062G06F3/0644G06F3/067G06F21/6218H04L9/3239H04L9/0869H04L63/0428H04L63/06G06F3/0623G06F3/0665H04L9/50G06F3/0604G06F3/0652G06F3/0659G06F21/602G06F21/6209H04L9/3236
Inventor 荆博
Owner BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap