Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Big data-oriented data management system

A data management system and big data technology, applied in the field of data management systems, can solve problems such as low compatibility, poor comprehensive ability, and small user-oriented range, and achieve reliable data collection, reasonable overall structure, and stable, reliable and fast data interaction Effect

Inactive Publication Date: 2018-02-02
温州市鹿城区中津先进科技研究院
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing big data platforms have low compatibility, are generally targeted platforms, and have poor comprehensive capabilities, that is, the scope of users is small

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data-oriented data management system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] Including collection center A, data center B, and user-oriented user center C;

[0018] Said collection center A: includes collection clusters, collection subsystems, data quality management subsystems, and collection backup subsystems that collect corresponding data. The collection subsystem performs routine collection on each collection cluster, and then the data The quality management subsystem performs preliminary quality management on the data and outputs it to the data center. At the same time, the collected data after preliminary quality management by the data quality management subsystem is backed up by the collection and backup subsystem;

[0019] Data center B: Including SQL server, HADOOP cluster subsystem that receives big data from SQL server and processes it; SQL server receives the collected data sent by collection center A and then recognizes and classifies it. If it is small data, SQL The server completes data classification, data processing and integration,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an efficient data management system. The system comprises an acquisition center, a data center and a user-oriented user center; a HADOOP cluster subsystem of the data center comprises a data integration module, a data cleaning module, a classification module and a data storage module; the data integration module is used for integrating multi-source heterogeneous data transmitted by the acquisition center through an SQL server so as to form structured data records; and the classification module is used for classifying the cleaned data. The system is capable of rapidly, efficiently and reliably carrying out data acquisition and data processing, and capable of providing application data for user subsystems in multiple industries. The data center is capable of completing big data, so that the processing and analysis of mass data become possible; and preliminary analysis is carried out on the mass data, so that data preparation is provided for the subsequent furtherapplication and analysis of users.

Description

Technical field [0001] The invention relates to a data management system, especially a data management system oriented to big data. Background technique [0002] With the rapid development of the national economy, the amount of data generated and stored in all walks of life is rising rapidly. "Big data" has penetrated into every industry and field and has become an important factor of production. The processing of big data is becoming more and more popular. Different from the traditional data structure characteristics, big data has three characteristics, including massiveness, distribution, and heterogeneity. Its massiveness mainly refers to the huge amount of data and the continuous increase in growth rate; its distribution is mainly reflected in the huge amount of data that cannot be stored on one machine for calculation and analysis; its heterogeneity is mainly reflected in the data type and data source diversification. Using the traditional centralized processing method for...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/21G06F16/215G06F16/27
Inventor 王振宇
Owner 温州市鹿城区中津先进科技研究院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com