Massive isomerous data storage method and system

A technology for heterogeneous data and data storage, which is applied in the fields of electronic digital data processing, other database indexing, and other database retrieval, etc., can solve the problem of not effectively supporting the analysis and processing of multi-source, heterogeneous, dynamic, and massive data, etc. Achieve the effect of solving storage problems and reducing costs

Inactive Publication Date: 2014-08-13
GUANGDONG XUANYUAN NETWORK & TECH
View PDF2 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] At present, in response to the complex processing requirements of massive data, the joint analysis of different types of data, complex associated queries, fast retrieval, etc., cannot be satisfied only through structured data processing methods
However, processing through the currently popular Hadoop and some of its sub-projects only supports the analysis and processing of a single type of static data, and still cannot effectively support the analysis and processing of multi-source, heterogeneous, dynamic, and massive data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Massive isomerous data storage method and system
  • Massive isomerous data storage method and system
  • Massive isomerous data storage method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.

[0024] figure 1 A data transmission structure of a method for storing massive heterogeneous data according to an embodiment of the present invention is schematically shown.

[0025] Such as figure 1 , 2 As shown, according to an embodiment of the present invention, a method for storing massive heterogeneous data is provided, including: multiple data loading servers 30 are registered on the load balancer 20; the client 10 sends data to the load balancer 20 load request; load balancer 20 dynamically assigns data loading server 30 to client 10, and client 10 transmits data to this data loading server 30; data loading server 30 according to the management information of data management node 41 in unified data management unit 40, will The data of the client 10 is loaded to the data storage node 42 .

[0026] The method for storing massive hete...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a massive isomerous data storage method and system which comprises a client, a load balancer, a data loading server and a unified data management unit. The client is used for collecting and receiving user data and transmitting a data loading request to the load balancer. The load balancer is used for dynamically distributing the data loading server to the client. The data loading server is used for loading data of the client to a data storage node according to management information of a data management node in the unified data management unit. The unified data management unit comprises the data storage node and the data management node. By means of the method and system, large data containing structured data, semi-structured data and non-structure data can be loaded together, and effective combination and unified storage management of massive structured data, semi-structured data and non-structure data are achieved. Compared with a traditional structured database, the method and system solves the storage problem of the structured data and the non-structured data and effectively reduces data management cost.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a method for storing massive heterogeneous data. Background technique [0002] In the information age, with the development of the Internet, multimedia, social media, the Internet of Things, and cloud computing, more and more data will be collected, and the generation of these data is extremely complex, which brings the exponential growth of data. growth trend. One of its characteristics is the intensive explosion of data, followed by the increasing difficulty of data processing, and people also realize that the commercial value brought by data is very huge. [0003] However, massive data does not only mean the explosive growth of data volume, it also involves a variety of heterogeneous data types, the coexistence of structured, semi-structured and unstructured states. There are more and more unstructured data such as pictures, audio, and video appearing on the Internet, and even th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F9/50
CPCG06F16/901
Inventor 吴礼裔
Owner GUANGDONG XUANYUAN NETWORK & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap