Check patentability & draft patents in minutes with Patsnap Eureka AI!

A distributed storage method and system based on a big data platform

A distributed storage, big data platform technology, applied in database update, structured data retrieval, database design/maintenance, etc., can solve problems such as abnormal storage, time-consuming data storage, and inability to guarantee complete data security, and avoid storage problems. Exceptional, storage-safe effects

Active Publication Date: 2022-04-26
睿至科技集团有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the continuous development of information science and technology, the use of big data platforms has become more and more frequent. Big data platforms have very powerful functions such as data transmission and storage. However, in the process of data storage based on big data platforms, data storage is still It is time-consuming, and in the process of data storage, the data often has the risk of abnormal storage. The common solution is to encrypt the data during the storage and transmission process, but only encryption cannot guarantee the complete security of the data. Storage is still a security risk

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed storage method and system based on a big data platform
  • A distributed storage method and system based on a big data platform
  • A distributed storage method and system based on a big data platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] Such as figure 1 As shown, it is a distributed storage method based on a big data platform provided by this application, which specifically includes the following steps:

[0024] Step S110: Obtain a storage data request.

[0025] Step S120: Determine a storage node set, and store the acquired data corresponding to the storage data request in the storage nodes of the storage node set.

[0026] Among them, there are multiple nodes prepared for storing data in the system, and one node is selected as the source node for receiving data. Wherein determining the set of storage nodes specifically includes the following sub-steps:

[0027] Step S1201: Determine the storage area.

[0028] Specifically, an arc is drawn with the source node as the center and the transmission distance of the source node as the radius, and the storage area is within the circle, and the boundary of the storage area is U.

[0029] Step S1202: Construct an initial storage node set according to the s...

Embodiment 2

[0091] Such as figure 2 As shown, the present application provides a distributed storage system based on a big data platform, which specifically includes: an acquisition unit 210 , a storage unit 220 , an initial selection unit 230 , a migration unit 240 , an update unit 250 , and an execution unit 260 .

[0092] The obtaining unit 210 is used to obtain source data.

[0093] The storage unit 220 is connected to the acquisition 210, and is configured to determine a storage node set, and store the acquired data corresponding to the storage data request in the storage nodes of the storage node set.

[0094] The initial selection unit 230 is connected to the storage unit 220, and is configured to initially select a cluster node in response to a request to store the acquired storage data in the storage node set.

[0095] The migration unit 240 is connected with the initial selection unit 230, and is used for performing data migration according to the cluster nodes in response to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

This application discloses a distributed storage method and system based on a big data platform, wherein the distributed storage method based on a big data platform specifically includes the following steps: obtaining a storage data request; determining a set of storage nodes, and sending the obtained storage data request The corresponding data is stored in the storage nodes of the storage node set; in response to storing the data in the storage node set, initially selecting a cluster node; in response to completing the initial selection of the cluster node, performing the first data migration according to the cluster node; in response to the cluster node The first data migration is completed, and the cluster nodes are updated; in response to completing the cluster node updates for a specified number of times, a cluster node set is determined, and each data storage migration is performed according to the cluster node set. This application can perform data storage migration within a specified time period after data is stored, avoiding storage abnormalities caused by node abnormalities, and making data storage more secure.

Description

technical field [0001] This application relates to the field of data processing, in particular, to a distributed storage method and system based on a big data platform. Background technique [0002] With the continuous development of information science and technology, the use of big data platforms has become more and more frequent. Big data platforms have very powerful functions such as data transmission and storage. However, in the process of data storage based on big data platforms, data storage is still It is time-consuming, and in the process of data storage, the data often has the risk of abnormal storage. The common solution is to encrypt the data during the storage and transmission process, but only encryption cannot guarantee the complete security of the data. Storage still has security risks. [0003] Therefore, how to provide a distributed storage method and system capable of solving hidden dangers of data storage security is an urgent problem to be solved by tho...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/21G06F16/23
CPCG06F16/214G06F16/23
Inventor 侯宝元
Owner 睿至科技集团有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com