Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Node management method and device, electronic equipment and storage medium

A node management and node technology, applied in the field of big data, can solve the problem of occupying too many resources and achieve the effect of saving server resources

Pending Publication Date: 2021-12-07
BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the embodiments of the present application is to provide a node management method, device, electronic equipment, and storage medium to solve the problem that multiple JobManagers need to be started on kubernetes at the same time to realize high-availability deployment of Flink on kubernetes and occupy more resources question

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Node management method and device, electronic equipment and storage medium
  • Node management method and device, electronic equipment and storage medium
  • Node management method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0068]Next, the technical scheme in the present application embodiment will be described in the present application embodiment, and it is understood that the described embodiments are merely the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, one of ordinary skill in the art is in the scope of the present application without making creative labor premistence.

[0069] Currently, one kind of high-availability Kubernetes Flink on deployment scenario is: Start plurality Flink JobManager (job management node), based on the Kubernetes ConfigMap (configuration dictionary), when a failure in the main JobManager switched to the standby JobManager simultaneously on kubernetes.

[0070] However, this solution in the implementation process, we need to launch multiple JobManager can be achieved Flink on kubernetes highly available deployment on kubernetes, take up more resources.

[0071] To this end, the present applica...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a node management method and device, electronic equipment and a storage medium, and belongs to the technical field of big data. The method comprises the steps of monitoring a running state of a job management node in a running process of the job management node; when it is monitored that the job management node quits operation due to the fault, acquiring a target snapshot stored in the operation process of the job management node, wherein the target snapshot is used for storing intermediate data in the operation process of the job management node; and restarting the job management node based on the target snapshot. Namely, high-availability deployment of the Flink on the kubernetes can be realized only by running one job management node, and a plurality of job management nodes do not need to be run at the same time, so that server resources are saved.

Description

Technical field [0001] The present application relates to large technical field of data, particularly to a node management method, apparatus, electronic apparatus and a storage medium. Background technique [0002] Flink (Distributed streaming data flow engine) as a new generation of big data processing engine, with its powerful computing capabilities and advanced design concepts, to become the current hot technology framework, is valued by many Internet companies. kubernetes (container orchestration engine) is a popular container layout tools, combined with the docker (application container engine) technology, can provide a powerful cluster resource management functionality, one of the main cloud solution container. [0003] Currently, one kind of high-availability Kubernetes Flink on deployment scenario is: Start plurality Flink JobManager (job management node), based on the Kubernetes ConfigMap (configuration dictionary), when a failure in the main JobManager switched to the s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/455G06F11/30G06F11/07
CPCG06F9/45558G06F11/3055G06F11/079G06F2009/45575
Inventor 郑舒力
Owner BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com