An enterprise-level big data platform architecture

A big data platform, enterprise-level technology, applied in database query, structured data retrieval, database distribution/replication, etc., can solve the problems of data silos, service silos, affecting enterprise efficiency, etc.

Inactive Publication Date: 2019-06-04
BEIJING UNIV OF TECH
View PDF4 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, there are many different technical teams internally, and each team works independently and has different cl...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An enterprise-level big data platform architecture
  • An enterprise-level big data platform architecture
  • An enterprise-level big data platform architecture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] Enterprise-oriented big data platforms are as follows figure 1 shown.

[0028] In the production of an enterprise, there must be a variety of data sources, and the data in the actual production environment must have the characteristics of multiple sources, complex types, and large volume. But we can divide the data into three categories. Including structured data, unstructured data and semi-structured data. Structured data generally comes from data in relational databases. These data are generally more standardized, have a certain data model, and follow certain data specifications; semi-structured data generally have certain structures such as xml and json, but it Does not conform to the relational data model structure of a relational database or other data tables, including related tags, used to separate semantic elements and to layer records and fields. Therefore, it is also called self-describing structure. Semi-structured data is a form of structured data; corres...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to enterprise-level big data platform architecture, and aims to improve standardization and efficiency of big data processing, extraction, storage and data mining of enterprisesin actual production at low cost. The big data platform can run on expandable common hardware based on Hadoop, Spark, Hive, Hbase and other Apache open source projects, and a complete big data technical system is constructed and comprises a data storage platform, an offline computing platform, a real-time computing platform and a machine learning platform. And enterprise computing tasks under various complex conditions can be met. The platform further comprises a set of complete data processing standards such as data storage, data quality supervision and ETL process standards, and strategy schemes such as core data protection and data authority control so as to ensure data quality normalization and data asset safety.

Description

technical field [0001] Big data technology has received high attention in recent years. All walks of life are embracing the Internet. With the transformation of traditional enterprises into E-enterprises, the data in the production and operation of enterprises has also been recorded. Big data is the basic means of production of enterprises. Data information is a valuable asset of an enterprise. Background technique [0002] Whether you have noticed it or not, the era of big data has arrived, and the trend of big data leads many changes that are quietly changing all walks of life. Although the word "big data" has only been widely circulated in recent years, in fact, all kinds of data have existed since a long time ago. The limitations of hardware functions and software technology have prevented people from using them effectively for a long time. Full amount of data, with the continuous innovation of technology, people can now easily use big data technology to process massive...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/24G06F16/27
Inventor 王劲松张建
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap