Big data management device based on Hadoop

A technology of big data and data, applied in the field of big data management devices based on Hadoop, to achieve the effect of improving applicability and practicability

Pending Publication Date: 2019-01-18
BEIJING UNIV OF POSTS & TELECOMM
View PDF7 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, the current big data governance devices are all aimed at a specific usage scenario, and have certain limitations in terms of use, management, and expansion.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data management device based on Hadoop
  • Big data management device based on Hadoop
  • Big data management device based on Hadoop

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0019] The Hadoop-based big data management device proposed according to the embodiment of the present invention is described below with reference to the accompanying drawings.

[0020] figure 1 It is a schematic structural diagram of a Hadoop-based big data management device according to an embodiment of the present invention.

[0021] Such as figure 1 As shown, this Hadoop-based big data governance device 10 includes: data governance information management module 100, data source selection module 200, data preview module 300,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a big data governance device based on Hadoop, comprising: a data governance information management module, which is used for maintaining the data governance operation information of each data source; a data source selection module, which is used for managing the data imported into the big data platform; the data preview module is used for displaying the basic information ofeach data table from the perspective of the structured database. A metadata management module, configured to present metadata information in a data table to a user in multiple dimensions; the data quality management module is used for checking the concrete missing information of each field in the data table and setting corresponding filling rules to complete filling of missing information. The multi-source data fusion module is used for fusing and summarizing multiple data tables of multiple data sources again to obtain a new data table, and further analyzing the new data table. The device utilizes large data components to complete multiple functional modules, which provides a highly reliable data basis for subsequent analysis and inquiry.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a Hadoop-based big data management device. Background technique [0002] At present, with the popularization of big data technology and related applications, data has become another important asset in addition to human resources, physical objects, finance, technology, intellectual property rights and relationships. Through the analysis of existing data, enterprises can better understand the recent operation situation, user usage, etc., so as to optimize the operation of the enterprise more accurately. However, under the current conditions, analysts need to spend a lot of time learning business database documents or consulting business personnel due to lack of understanding of the real situation of enterprise data, and data preparation requires specialized data engineers to do ETL, which may easily lead to slower delivery. If not, problems are prone to occur in the middle...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455G06F16/25G06F16/28G06F16/26
Inventor 鄂海红宋美娜白杨
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap