Flink-based task execution method, device, computer equipment and storage medium
A task execution and task data technology, applied in the computer field, can solve problems such as poor service scalability, confusing version calls, high development and maintenance costs, etc., and achieve the effects of avoiding call confusion, improving efficiency, and facilitating rapid processing
Active Publication Date: 2022-04-19
CHINA PING AN LIFE INSURANCE CO LTD
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
If the service is designed so that only one version of Flink can be submitted, it cannot meet the needs of customers for frequent changes in the Flink version; if multiple services are used, and each service supports a Flink version, then the development and operation costs are too high; When a service submits multiple Flink versions, there will often be confusion in calling versions, resulting in poor scalability, poor stability, and difficulty in iteration of the entire service, increasing development and maintenance costs
At the same time, there are also cases where the data processing speed of the server executing the Flink task is slow and the efficiency is low
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0052] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field of the application; the terms used herein in the description of the application are only to describe specific embodiments The purpose is not to limit the present application; the terms "comprising" and "having" and any variations thereof in the specification and claims of the present application and the description of the above drawings are intended to cover non-exclusive inclusion. The terms "first", "second" and the like in the description and claims of the present application or the above drawings are used to distinguish different objects, rather than to describe a specific order.
[0053] Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrenc...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The embodiments of the present application belong to the field of computer technology and are applied to the field of smart communities, and relate to a Flink-based task execution method, device, computer equipment, and storage medium, including storing received Flink data packets in a pre-established sub-system based on the version number. In the directory folder; the target Flink version number is determined based on the received user task data; the target subdirectory folder is determined based on the target Flink version number and the target Flink version number, and the Flink data package in the target subdirectory folder is used as the target Flink data packets are loaded into memory; the task allocation method and data to be processed in the user task data are obtained, and when the amount of data to be processed distributed to each server is uneven, the preset data allocation method is called to re-allocate to each server The data to be processed; the target Flink data packet in the running memory. Flink data packets can be stored in the blockchain. This application can support the invocation of Flink tasks of different versions, while avoiding the confusion of Flink version invocation.
Description
technical field [0001] The present application relates to the field of computer technology, and in particular to a Flink-based task execution method, device, computer equipment, and storage medium. Background technique [0002] With the rapid development of computer technology, while computers have changed people's lifestyles, they have also been gradually applied to online data processing in various industries. Among them, Flink is an important framework for real-time computing. Many companies have developed services that specifically submit Flink tasks, but such services will be limited by the Flink version. That is, for the same service, the Flink version of each submitted task needs to be consistent. . At present, with the continuous update of the Flink community, there are many different versions of Flink. Due to the differences between each version, users often choose different Flink versions for different tasks. If the service is designed so that only one version o...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/445
CPCG06F9/44521G06F9/44536G06F9/44594
Inventor 李金阳
Owner CHINA PING AN LIFE INSURANCE CO LTD