Unlock instant, AI-driven research and patent intelligence for your innovation.

Apache Kylin hosting system and method based on cloud computing

A cloud computing and computing module technology, applied in the field of data analysis, which can solve the problems of high use threshold, large investment, and difficulty in deploying and maintaining clusters.

Pending Publication Date: 2021-03-26
KUYUN SHANGHAI INFORMATION TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, when enterprises use Apache Kylin for data analysis, they mainly encounter three problems. First, Apache Kylin needs to run on Hadoop clusters. For enterprises that do not have Hadoop clusters, it is difficult to deploy operation and maintenance clusters. Using The threshold is also relatively high, requiring corresponding big data talents
Second, in the face of the ever-increasing mass data and access traffic, it is necessary to continuously increase the IT infrastructure and invest heavily

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Apache Kylin hosting system and method based on cloud computing
  • Apache Kylin hosting system and method based on cloud computing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] Embodiment 1 of the present invention provides a cloud computing-based Apache Kylin hosting system, such as figure 1 As shown, it includes the management module, computing module, application module and monitoring module. The management module is set up on the virtual machine, responsible for the application and creation of cloud infrastructure, and is used to manage the deployment and operation and maintenance of the computing module, application module and monitoring module. , the computing module is a distributed computing cluster composed of at least 4 nodes, used to provide computing and storage resources for the application module, the application module is used to provide OLAP analysis capabilities and data visualization capabilities, and the monitoring module is used to monitor the computing module and application module monitoring.

[0031] The management module runs on an independent virtual machine, and automatically creates the required cloud infrastructure ...

Embodiment 2

[0037] Embodiment 2 of the present invention provides a cloud computing-based Apache Kylin hosting method, and the method is applied in the above-mentioned cloud computing-based Apache Kylin hosting system, such as figure 2 shown, including the following steps:

[0038] Step 1: The management module applies for and creates cloud infrastructure, and deploys computing modules, application modules and monitoring modules;

[0039] During implementation, Apache Kylin and clusters can be deployed on the cloud by simply clicking a few buttons using the management module, which greatly reduces the difficulty of operation and maintenance deployment and lowers the threshold for use.

[0040] Step 2: The application module uses Apache Kylin as the OLAP engine to submit calculation tasks to the calculation module;

[0041] Step 3: The computing module automatically scales the computing nodes to perform computing tasks;

[0042] During specific implementation, according to the current l...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an Apache Kylin hosting system and method based on cloud computing, and the method comprises the steps: setting a management module on a virtual machine to be responsible for the application and creation of infrastructure on the cloud, wherein the management module automatically creates needed computing, storage and network resources in a cloud platform account of a user through the call of a public interface provided by a cloud platform; enabling nodes in the calculation and storage separation cluster to only provide calculation resources, and employing object storage as storage resources; taking Apache Kylin as an OLAP engine, and arranging data visualization software in the Apache Kylin. Based on the method and the system, the OLAP analysis platform with low threshold, low cost and high performance can be quickly constructed on the cloud, and the data analysis requirements of enterprises on the cloud are met.

Description

technical field [0001] The present invention relates to the technical field of data analysis, in particular to a cloud computing-based Apache Kylin hosting system and method. Background technique [0002] At present, Apache Kylin is an open source distributed analysis engine that provides SQL query interface and multidimensional analysis (OLAP) capabilities on Hadoop / Spark, supports sub-second query for ultra-large-scale data, and has been adopted by thousands of companies around the world. . At present, when enterprises use Apache Kylin for data analysis, they mainly encounter three problems. First, Apache Kylin needs to run on Hadoop clusters. For enterprises that do not have Hadoop clusters, it is difficult to deploy operation and maintenance clusters. Using The threshold is also relatively high, requiring corresponding big data talents. Second, in the face of the ever-increasing mass data and access traffic, it is necessary to continuously increase the IT infrastructur...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/455G06F9/50G06F11/30
CPCG06F9/45558G06F9/5083G06F11/302G06F2009/4557G06F2009/45579G06F2009/45595
Inventor 石鹏磊夏赟伟李扬韩卿
Owner KUYUN SHANGHAI INFORMATION TECH CO LTD