Federal storage method, device, terminal and storage medium for unstructured data

A technology of unstructured data and federation, applied in the direction of electrical digital data processing, input/output process of data processing, instruments, etc., can solve problems such as process complexity, achieve improved efficiency, increased storage capacity, and good scalability Effect

Active Publication Date: 2022-07-29
GUANGDONG POWER GRID CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a method, device, terminal and storage medium for federated storage of unstructured data, so as to solve the problem that the existing cluster expansion requires data migration and the process is complicated

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Federal storage method, device, terminal and storage medium for unstructured data
  • Federal storage method, device, terminal and storage medium for unstructured data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0042] It should be understood that the step numbers used in the text are only for the convenience of description, and are not intended to limit the order in which the steps are performed.

[0043] It should be understood that the terms used in the present specification are only for the purpose of describing particular embodiments and are not intended to limit the present invention. As used in this specification and the appended claim...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a federal storage method, device, terminal and storage medium for unstructured data. The method includes: establishing a federal node unique identification code specification; establishing a federal node access specification according to the federal node unique identification code specification ; Register the normative information of the access specification of the federated node to the registration center, and obtain the short code returned by the registration center; According to the short code and the object id generation specification, generate an id for the object entity stored on the federated node . The storage method provided by the present invention has more efficient performance. By providing multiple NameNodes to provide external services at the same time, the reading speed will not be reduced according to the storage capacity, and the amount of data that can be stored is larger; at the same time, the method has good scalability. Scalability can improve storage efficiency by adding new NameNode and DataNode, and will not affect the existing data storage efficiency while increasing storage capacity.

Description

technical field [0001] The present invention relates to the technical field of data storage, in particular to a method, device, terminal and storage medium for federated storage of unstructured data. Background technique [0002] At present, 80% of the data in the enterprise is unstructured data, so the importance of mass unstructured data storage is obvious. Among them, the existing mainstream unstructured data storage method is to use hadoop cluster to store unstructured data in hdfs system. However, if the cluster storage capacity encounters a bottleneck and needs to be expanded, the existing data needs to be migrated, which makes the cluster expansion process complicated and inefficient. SUMMARY OF THE INVENTION [0003] The purpose of the present invention is to provide an unstructured data federation storage method, device, terminal and storage medium, so as to solve the problem that the existing cluster expansion needs to perform data migration and the process is c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0604G06F3/0614G06F3/067
Inventor 江疆冯歆尧蔡徽钱正浩杨秋勇谢瀚阳陈浩刘高郭锦超饶成成廖如超陈赟
Owner GUANGDONG POWER GRID CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap