Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Platform system, method and device for realizing one-stop task development, deployment and operation and maintenance functions based on Flink, memory and storage medium

A task and platform technology, applied in the field of data processing, can solve problems such as low efficiency, high potential risks, and correspondence, so as to prevent misuse, optimize application effects, and avoid development effects

Inactive Publication Date: 2021-11-02
GUOTAI JUNAN SECURITIES
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At the same time, the code developed is also difficult to be reused by others directly, and the efficiency is very low
[0004] Secondly, after a large number of developed flink tasks are submitted to the cluster, it is difficult for developers to match tasks with specific development projects, and daily task maintenance is very troublesome
[0005] And because flink itself has almost no permission control function, any user who has access to the flink cluster can modify, start and stop other people's tasks, and even directly shut down and destroy the entire flink cluster, which has great potential risks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Platform system, method and device for realizing one-stop task development, deployment and operation and maintenance functions based on Flink, memory and storage medium
  • Platform system, method and device for realizing one-stop task development, deployment and operation and maintenance functions based on Flink, memory and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] In order to describe the technical content of the present invention more clearly, further description will be given below in conjunction with specific embodiments.

[0061] Before describing in detail embodiments according to the present invention, it should be noted that, hereinafter, the terms "comprises", "comprises" or any other variant thereof are intended to cover a non-exclusive inclusion, thereby enabling the process of including a series of elements A method, article, or device includes not only these elements, but also other elements not expressly listed, or inherent to such a process, method, article, or apparatus.

[0062] see figure 1 As shown, the Flink-based platform system for one-stop task development, deployment, and operation and maintenance functions, wherein the system includes:

[0063] The authority management control module, the background manager uses the authority management control module to control the task authority of the task developer; ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a platform system for realizing one-stop task development, deployment and operation and maintenance functions based on Flink, and the system comprises: an authority management control module, which is used for carrying out task authority control on task developers; a task development processing module, which is used for performing project creation to generate a development task; a Flink cluster processing module, which is used for performing multi-process data processing on the registration data source; a task debugging processing module, which is used for performing single-step debugging processing on the development task; a task issuing processing module, which is used for issuing the development task to the Flink cluster; and a task maintenance processing module, which is used for operation and maintenance personnel to execute background maintenance of the development task. The invention further relates to a corresponding method and device, a processor and a storage medium thereof. By adopting the system, the method, the device, the processor and the storage medium of the invention, the tasks from release to production are operated and maintained on the operation and maintenance page, and the operation and maintenance page is displayed according to the levels of the items and the tasks, is clear and organized, and has a better application effect.

Description

technical field [0001] The present invention relates to the field of data processing technology, in particular to the field of data processing technology for task development, and specifically refers to a platform system, method, device, memory and computer based on Flink to realize one-stop task development, deployment, operation and maintenance functions storage medium. Background technique [0002] Flink is a common stream computing engine in the industry, but it has many shortcomings when used in a production environment. [0003] First of all, the development of flink tasks is extremely cumbersome. It is necessary to configure the development environment in the IDE first, and then use scala, java, python, or SQL to develop debugging and tasks. During development, developers need to perform data source registration, data cleaning, and aggregation. , Data calculation and output the whole process. This requires each developer to study various APIs and background principl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/30G06F8/60G06F16/215G06F16/242
CPCG06F8/30G06F8/60G06F16/215G06F16/2433
Inventor 俞枫苑博刘召羽张玲岩
Owner GUOTAI JUNAN SECURITIES
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com