Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Big data loading system and method

A loading system and data storage system technology, applied in the field of big data loading system, can solve the problem that the big data loading platform cannot support both structured data and unstructured data processing

Inactive Publication Date: 2013-12-11
SUGON INFORMATION IND
View PDF4 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] To sum up, the main problem of the existing technology is that the big data loading platform cannot support the processing of structured data and unstructured data at the same time, and ensure the real-time performance of data analysis

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data loading system and method
  • Big data loading system and method
  • Big data loading system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] In order to make the technical solutions and advantages of the present invention clearer, the exemplary embodiments of the present invention will be described in further detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of them. Exhaustive list of examples.

[0023] like figure 1 As shown, an embodiment of the present invention provides a big data loading system, which includes: a client 101 for receiving user data; a data storage system 104 for storing user data; a metadata database 105 for storing user data management information, where the management information includes data structures, data attributes, and data storage locations; and a loading server 103 that establishes a connection with the client 101 to receive user data from the client 101 and, according to the status of the data storage system 104 and the metadata database 105 The information ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a big data loading system. The big data loading system comprises a client side for receiving user data, a data storage system for storing the user data, and a meta-database for storing management information of the user data, wherein the management information includes the data structure, the data property and the data storage position. The big data loading system further comprises a loading server, wherein the loading system is connected with the client side, receives the user data from the client side and loads the user data into the data storage system according to state information of the data storage system and the management information of the meta-database. The invention further discloses a big data loading method. According to the big data loading system and method, effective combination and unified storage management of mass structured data, semi-structured data and unstructured data are achieved, and the possibility is provided for linkage, analysis and lookup of the mass-structured data, the semi-structured data and the unstructured data.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a big data loading system and method. Background technique [0002] With the rapid development of cloud computing, Internet of Things, social networks, and mobile Internet, the amount of data is growing at an unprecedented rate and is becoming more concentrated, and this trend will continue. Data is rapidly expanding and becoming larger. The larger the scale of data, the more difficult it is to process, but the greater the value that may be obtained by mining it, and people are becoming more and more aware of the importance of data. [0003] However, the crisis of massive data is not simply the explosive growth of data volume, it also involves changes in data types. In the past, data can basically be represented by a two-dimensional table structure and stored in the database, that is, structured data. However, with the emergence of more and more Internet multimedia applications, unst...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 狄静舒王颖宋怀明苗艳超刘新春邵宗有
Owner SUGON INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com