Task monitoring method, device and equipment based on data medium, and medium
A task monitoring and task technology, applied in computer equipment and storage media, in the field of task monitoring based on the data middle platform, can solve the problems of limited application scenarios, inability to adapt to multi-scenario task progress monitoring, etc., and achieve the effect of expanding usage scenarios
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
no. 1 example
[0050] In one embodiment, as the first embodiment of acquiring the follow-up task data described in step S104, it includes:
[0051] If it is determined that the remaining memory size value of the distributed computing engine exceeds the preset memory threshold, the follow-up task data in the task middle-stage server is obtained through the change data acquisition plug-in in the distributed computing engine.
[0052] In this embodiment, the submitted changes (these changes) can be obtained from the server in the task middle stage through the change data acquisition plug-in in the distributed computing engine (for example, FlinkCDC, that is, Flink's Change Data Capture, which means change data acquisition). Can include INSERT, DELETE, UPDATE, etc.), and save these changes to the distributed computing engine for use by the distributed computing engine. For example, when the follow-up task data of the mid-task server is obtained through FlinkCDC, the follow-up task data is stored...
no. 2 example
[0053] In one embodiment, as the second embodiment of acquiring the follow-up task data described in step S104, it includes:
[0054] If it is determined that the value of the remaining memory size of the distributed computing engine does not exceed the preset memory threshold, obtain the connection string information of the server in the middle of the task, and establish a connection with the server in the middle of the task according to the connection string information to obtain the follow-up task data, sending the follow-up task data to the distributed computing engine.
[0055] In this embodiment, if the current remaining memory of the distributed computing engine is extremely small and is not enough to handle the acquisition of follow-up task data based on the change data plug-in, the distributed computing engine can be based on the connection string information ( i.e. JDBC connection string) to establish a connection with the task mid-stage server, directly obtain the f...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More 


