A big data warehouse design method and system based on visualization

A design method and data warehouse technology, applied in the computer field, can solve problems such as error-prone, troublesome operation, and high learning costs, and achieve the effect of monitoring

Inactive Publication Date: 2019-04-26
CHENGDU SEFON SOFTWARE CO LTD
View PDF8 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Developers are required to use the command line to operate and manage. The whole operation is cumbersome and error-prone, and managers need to be proficient in using the relevant operation commands of the big data warehouse. The learning cost is high and the professional developers are highly dependent

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A big data warehouse design method and system based on visualization
  • A big data warehouse design method and system based on visualization
  • A big data warehouse design method and system based on visualization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] Such as figure 1 As shown, a large data warehouse design method based on visualization, the realization of data warehouse creation includes the following steps:

[0036] S100: The user enters the name, alias and description of the data warehouse on the visual operation interface, and selects the type of data warehouse to be created. The database type includes a theme library and a market library. The theme library is the user's meta-database, and the market library refers to For a new business library based on the theme library, for example, if the user does not need to use all the table data in the theme library for some business scenarios, then the user can create a new market library and only add the tables that need to be used in the theme library, so that the user can directly The data can be analyzed by using the bazaar library, so as to achieve more efficient query efficiency.

[0037] S200: The user chooses to submit, and submits the database building informati...

Embodiment 2

[0044] Such as figure 2 As shown, a large data warehouse design method based on visualization, the implementation of database table creation includes the following steps:

[0045] S100: The user creates a certain data warehouse table on the visual operation interface, and inputs the table name, table type, table comment, table column, and table relationship. The table columns are divided into common columns and partition columns. The table type can be TEXTFILE, RCFILE, ORC, PARQUET, MAPPING_HBASE, where MAPPING_HBASE is a mapping hbase table, which means that the table is created in hive but the data is stored in hbase.

[0046] S200: The user chooses to submit, and submits the table creation information to the JAVA service unit through AJAX.

[0047] S300: The JAVA service unit determines a specific operation type according to the service interface type.

[0048] S400: Encapsulate key information such as data table names, table types, table comments, and table columns in t...

Embodiment 3

[0053] Such as image 3 As shown, a large data warehouse design method based on visualization, which realizes the establishment of data table relationships includes the following steps:

[0054] S100: The user enters the details of the data warehouse through the visual operation interface, and selects a relational design to associate and set tables in the data warehouse.

[0055] S200: The user chooses to submit, and submits the associated information of the data table to the JAVA service unit through AJAX.

[0056] S300: the JAVA service unit stores the associated information of the data table into the MySQL database.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a big data warehouse design method and system based on visualization. The method comprises the following steps that library building and table building information is maintained through a visualization operation interface; Submitting the database building and table building information to a JAVA service unit; The JAVA service unit determines a specific operation type according to the service interface type; Packaging the database building and table building information into a Hive data warehouse executable command; Connecting the JAVA service unit to a HiveServer 2 service; Submitting the executable command to a Hive data warehouse; And executing the command in the Hive data warehouse, and creating a database or a data table. A visual database building and table building data maintenance interface is provided, a data warehouse data table is created based on a hive + hbase mode, the operation modes of new building, editing, deleting and modifying of the big datawarehouse are simplified, new building, editing, deleting and modifying of the data table in the big data warehouse are achieved, and relation building of the data table in the big data warehouse is achieved.

Description

technical field [0001] The invention belongs to the technical field of computers, and in particular relates to a visualization-based large data warehouse design method and system. Background technique [0002] A data warehouse is a warehouse built on a computer storage device that organizes, stores, and manages data according to the data structure. Simply put, it can be regarded as an electronic file cabinet, that is, a place where electronic files are stored. Data management operations such as adding, intercepting, updating, and deleting. With the continuous development of the Internet and the advent of the era of big data, more and more companies are using big data, and big data requires big data warehouses for storage. Therefore, the management of big data warehouses has become an inevitable problem for enterprises. [0003] Usually, no matter which program is used to perform database-related operations, the developer knows the structure of the database in advance and p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21
Inventor 王川王纯斌陈佳伟张杰梁
Owner CHENGDU SEFON SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap