Unlock instant, AI-driven research and patent intelligence for your innovation.

A centerless data management method and device

A data management and data technology, applied in the field of information processing, can solve the problems of high system cost and maintenance cost, large storage equipment, general system reliability, etc., and achieve the effect of improving reliability.

Active Publication Date: 2021-10-08
吴俊杰
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the system is expensive to build and maintain
[0006] Third, system reliability is average
Undoubtedly, once there is any abnormality in the storage center, or any problem in the link between the working node such as the camera and the central node, the system and node storage will be abnormal
[0007] Fourth, the security is insufficient. All data is stored in one center, which cannot eliminate the user's data security concerns.
[0010] (2) It is difficult to dump and backup. Due to the large amount of data, dumping not only consumes huge storage devices, but also requires high-end servers and network resources
[0011] (3) Retrieval is difficult; manually looking for valuable clues from a large amount of video data needs to be watched one by one, which is low in efficiency, high in work intensity, and boring
[0012] (4) Analysis and processing consume a lot of computing resources, and traditional central processing nodes often form a system bottleneck

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A centerless data management method and device
  • A centerless data management method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] figure 1 It is a schematic flow chart of the method of the embodiment of the present invention. A centerless data management method in this embodiment is applied to a data source end, and the data source end communicates with a storage node.

[0057] 1. Storage node preparation process:

[0058] There are n storage nodes, and n is a natural number; the data source and n storage nodes respectively establish p2p communication; various classic p2p schemes can be adopted, such as based on stun, ice, turn, etc., to establish data sources and multiple storage points Inter-p2p communication. This communication method is already a mature technology, which is referred to as "p2p" in the text, and the details will not be repeated. Storage nodes can be computers, mobile phones, routers with storage functions in users' homes, network storage servers, and other devices with storage functions.

[0059] The storage node reports reliability (such as online rate), storage capacity and...

Embodiment 2

[0076] Based on the same inventive concept as the above-mentioned non-central data management method, a kind of non-central data management device of this embodiment includes:

[0077] A first obtaining unit, the first obtaining unit is used to obtain the first information obtained by the data source from the storage node, the first information is the reliability of each storage node;

[0078] The first fragmentation unit, the first fragmentation unit is used to encode and fragment the source data at the data source end into a plurality of single pieces of data to form the second information;

[0079] The second obtaining unit obtains third information, where the third information is the reliability of a single piece of data;

[0080] A third obtaining unit, the third obtaining unit is configured to obtain fourth information according to the third information, where the fourth information is a storage node group for storing a single piece of data;

[0081] A fourth obtaining ...

Embodiment 3

[0086] Based on the same inventive concept as the aforementioned centerless data management method, a centerless data management device in this embodiment includes a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor The following steps are implemented when executing the program:

[0087] The data source obtains first information from the storage nodes, where the first information is the reliability of each storage node;

[0088] The source data at the data source end is coded and fragmented into multiple single pieces of data, which is the second information;

[0089] Obtain the third information, the third information is the reliability of a single piece of data fragment; the third information is obtained according to the sixth information;

[0090] Obtaining fourth information according to the third information, where the fourth information is a storage node group for storing a single piece of data;

[0091] O...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a centerless data management method and device. The method of the present invention is applied to a data source end, and the data source end communicates with the storage node, including: the data source end obtains first information from the storage node, and the first information is the reliability of each storage node; the source data of the data source end The second information is coded and fragmented into multiple single pieces of data; the third information is obtained according to the first information, and the third information is the reliability of a single piece of data; the fourth information is obtained according to the third information, and the fourth information is used The storage node group is used to store a single piece of data; the fifth information is obtained according to the fourth information, and the fifth information is a set of storage node groups used to store the multiple pieces of data; and the second information is respectively stored in the storage on all storage nodes in each corresponding storage node group of the node group set. The present invention adopts a decentralized and distributed data storage scheme, which greatly reduces the construction, operation and maintenance costs of data storage.

Description

technical field [0001] The present invention relates to information processing technology, in particular to a centerless data management method and device. Background technique [0002] There are many storage devices and methods for data. Taking video surveillance data storage as an example, the cloud storage currently used for video surveillance adopts a center and center-like structure, that is, all data is transmitted and stored in one or more central nodes. [0003] However, these data, such as video data, have attributes such as high complexity and huge data volume, which pose huge challenges to storage, management and use: [0004] First of all, the fixed cost of employee salaries, legal costs, and data center rent in the storage center is constant or gradually increasing, making the price of centralized cloud services high and cannot be reduced. [0005] Secondly, in order to ensure high reliability, it is necessary to guarantee power, network bandwidth, storage dev...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0626G06F3/0631G06F3/0643G06F3/067
Inventor 吴俊杰吴嘉祯吴嘉会吴俊丽孙伟
Owner 吴俊杰