Unstructured data federated storage method and device, terminal and storage medium

An unstructured data, federated technology, applied in the direction of electrical digital data processing, data processing input/output process, instruments, etc., can solve problems such as complex process, achieve high efficiency, good scalability, and increase storage capacity. Effect

Active Publication Date: 2021-08-31
GUANGDONG POWER GRID CO LTD
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a method, device, terminal and storage medium for federated storage of unstructured data, so as to solve the problem that the existing cluster expansion requires data migration and the process is complicated

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unstructured data federated storage method and device, terminal and storage medium
  • Unstructured data federated storage method and device, terminal and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0042] It should be understood that the step numbers used herein are only for convenience of description, and are not intended to limit the execution order of the steps.

[0043] It should be understood that the terminology used in the description of the present invention is for the purpose of describing particular embodiments only and is not intended to limit the present invention. As used in this specification and the appended claims, the singular forms "a", "an"...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an unstructured data federated storage method and device, a terminal and a storage medium. The method comprises the following steps: establishing a federated node unique identification code specification; establishing a federated node access specification according to the federated node unique identification code specification; registering specification information of the federated node access specification to a registration center, and obtaining a brief code returned by the registration center; and generating an id for the object entity stored on the federated node according to the brief code and the object id generation specification. The storage method provided by the invention has more efficient performance, and the reading speed is not reduced according to the storage capacity by providing a plurality of NameNode to provide services to the outside at the same time, so that the storable data volume is larger; meanwhile, the method has good expandability, the storage efficiency can be improved by adding new NameNode and DataNode, and the existing data storage efficiency cannot be influenced while the storage capacity is increased.

Description

technical field [0001] The present invention relates to the technical field of data storage, in particular to a method, device, terminal and storage medium for federated storage of unstructured data. Background technique [0002] At present, 80% of the data in enterprises is unstructured data, so the importance of massive unstructured data storage can be seen. Among them, the existing mainstream unstructured data storage method is to use the hadoop cluster to store unstructured data in the hdfs system. However, if the storage capacity of the cluster encounters a bottleneck and needs to be expanded, the existing data needs to be migrated, which makes the cluster expansion process complicated and inefficient. Contents of the invention [0003] The purpose of the present invention is to provide a method, device, terminal and storage medium for federated storage of unstructured data, so as to solve the problem that the existing cluster expansion requires data migration and th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0604G06F3/0614G06F3/067
Inventor 江疆冯歆尧蔡徽钱正浩杨秋勇谢瀚阳陈浩刘高郭锦超饶成成廖如超陈赟
Owner GUANGDONG POWER GRID CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap