Big data service component deployment method and system, terminal and storage medium

Abstract

The invention relates to the technical field of big data, and particularly provides a big data service component deployment method and system, a terminal and a storage medium, and the method comprises the steps that a dependency tree graph is edited through a browser interface, and the dependency tree graph indicates a dependency relationship between to-be-deployed service components and identity information and deployment addresses of the to-be-deployed service components; the dependency relationship is converted into a deployment sequence of the service components, installation files of the service components are called in sequence according to the deployment sequence, and the corresponding installation files are executed according to the identity information and deployment addresses of the to-be-deployed service components; and creating a distributed monitoring process, wherein the distributed monitoring process monitors the operation information of the deployed service component. According to the method, the big data cluster has the management capability of multi-service deployment, a clear and visual service dependency relationship is provided, and node conflicts among multiple deployments of the same big data component in the implementation process are effectively avoided.

Description

technical field [0001] The present invention relates to the technical field of big data, in particular to a method, system, terminal and storage medium for deploying big data service components. Background technique [0002] There is an interdependent relationship between big data service components. For example, the underlying storage of HBase depends on HDFS, and the high-availability deployment of HDFS needs to rely on Zookeeper. For enterprise-level data centers, in complex application scenarios, multiple deployments of the same service component are often required. For example, multiple sets of HBase or HDFS clusters are deployed in the same physical cluster. These clusters supported by different clusters of the same component Business and data are independent of each other, and jointly carry a large and complex big data cluster. However, during the implementation process, the dependencies between multiple services are prone to problems such as crossover and conflict, ...

AI Technical Summary

Problems solved by technology

[0003] Aiming at the problem that the dependencies between multiple services existing in the existing big data service component deployment method are prone to overlap and conflict, the present invention provides a big data service component deployment method, system, terminal and storage medium to avoid The structural chaos of multi-service deployment provides great convenience for cluster management

Images