Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Decoupling method for flink stream calculation dependent file and mirror image in cloud native scene

A technology that relies on files and stream computing. It is applied in software deployment, software maintenance/management, version control, etc. It can solve the problems of flink dependent packages and user code packages rebuilding mirrors, etc., and achieve the effect of improving efficiency.

Pending Publication Date: 2021-06-25
杭州玳数科技有限公司
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to solve the problem that the update of flink dependent packages and user code packages needs to rebuild the image, the present invention provides a method for decoupling the dependent files and images of stream computing based on flink in cloud-native scenarios

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Decoupling method for flink stream calculation dependent file and mirror image in cloud native scene
  • Decoupling method for flink stream calculation dependent file and mirror image in cloud native scene
  • Decoupling method for flink stream calculation dependent file and mirror image in cloud native scene

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0030] The present invention provides a method for decoupling flink stream computing dependent files and images in cloud-native scenarios, including the following steps:

[0031] 1) File system configuration and dependent file upload; add and configure the target file system in an interface-based manner, select the created file system, and upload dependent files;

[0032] 2) Build the basic image of the task; provide the basic environment for the task to run;

[0033] 3) Implement flink-on-k8s plug-in and flink custom mount.

[0034] Such as figure 1 As shown, the step 1) includes the following steps:

[0035] 1.1) Add a configuration file system, click Add Component to select the target file system to add, and fill in different configuration items according to different file systems;

[0036] 1.2) Click Save to test whether the added file system can be connected;

[0037] 1.3) Select Resource Management on the interface, click Upload Resource, and fill in the attribute in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a decoupling method for a flink stream calculation dependent file and a mirror image in a cloud native scene. The method comprises the following steps: 1) configuring a file system and uploading a dependent file; 2) constructing a task basic mirror image; and (3) achieving an flink-on-k8s plug-in unit and an flink user-defined mount. Compared with the prior art, the method has the advantages that the program dependent package and the docker mirror image are decoupled, the mirror image only needs to be constructed once in the development iteration process, subsequent requirements of a user can be met, the mirror image does not need to be updated no matter whether the user updates the task program package or updates the flink dependent package in the mode, and the development iteration efficiency is improved.

Description

technical field [0001] The invention relates to a method for decoupling dependent files and images of stream computing based on flink in a cloud-native scenario. Background technique [0002] Currently, the jar files that flink on kubernetes stream computing tasks depend on are implanted in advance when building the docker image. Whenever the task dependency files are updated, the image needs to be rebuilt, which increases the burden of development iterations. Contents of the invention [0003] In order to solve the problem that the update of the flink dependent package and the user code package needs to rebuild the image, the present invention provides a method for decoupling the stream computing dependent file and the image based on flink in the cloud native scenario. [0004] A method for decoupling flink stream computing dependent files and images in cloud-native scenarios, including the following steps: [0005] 1) File system configuration and dependent file upload;...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F8/61G06F8/65G06F8/71
CPCG06F8/63G06F8/65G06F8/71
Inventor 郝卫亮
Owner 杭州玳数科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products