Unlock instant, AI-driven research and patent intelligence for your innovation.

Deployment method, device, medium and electronic device of big data distributed cluster

A technology of distributed clusters and electronic devices, applied in the computer field, can solve the problem of low deployment efficiency of Presto, and achieve the effect of improving deployment efficiency

Active Publication Date: 2022-08-09
JINGDONG TECH HLDG CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the embodiment of the present invention is to provide a large data distributed cluster deployment method, device, medium and electronic equipment, and then overcome the problem of low efficiency of Presto deployment in the prior art at least to a certain extent

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deployment method, device, medium and electronic device of big data distributed cluster
  • Deployment method, device, medium and electronic device of big data distributed cluster
  • Deployment method, device, medium and electronic device of big data distributed cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments, however, can be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art.

[0033] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present invention. However, those skilled in the art will appreciate that the technical solutions of the present invention may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be employed. In other instances, well-known methods...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the present invention provide a method, apparatus, medium and electronic device for deploying a big data distributed cluster. The method includes: acquiring configuration information of each electronic device to be deployed in the cluster, where the configuration information includes Presto Installation path information and JDK installation path information; parse the installation package file of the big data distributed cluster based on the configuration information of each of the electronic devices to be deployed, and determine multiple differential configurations for deploying the big data distributed cluster A template and a common configuration template; deploy each of the electronic devices to be deployed in the cluster according to the plurality of difference configuration templates and the common configuration template, so as to generate the big data distributed cluster. The technical solutions of the embodiments of the present invention improve the deployment efficiency of the Presto cluster.

Description

technical field [0001] The present invention relates to the field of computer technology, and in particular, to a method, apparatus, medium and electronic device for deploying a big data distributed cluster. Background technique [0002] Big data distributed cluster Presto is a big data distributed structured query language (Structured Query Language, SQL) query engine developed by Facebook based on Java, which can quickly and interactively query massive data from GB level to petabyte level. , the query speed reaches the level of commercial data warehouse. Presto is widely used in the field of ad hoc query because of its high performance, high stability, rich functions and perfect integration with Hadoop big data ecology. [0003] In the prior art, the operation steps of the deployment mode of Presto: first distribute the installation package of Presto to each node that needs to be deployed; Secondly, log in to these deployment nodes one by one, modify the Java virtual mach...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F8/61G06F8/30
CPCG06F8/30G06F8/61
Inventor 桂宇
Owner JINGDONG TECH HLDG CO LTD