Task processing method and device, electronic equipment and computer readable medium

Abstract

The embodiment of the invention discloses a task processing method and device, electronic equipment and a computer readable medium. According to one specific embodiment, the method comprises: in response to a received task execution request, initializing target task configuration information to generate initialized task configuration information, wherein the initialized task configuration information comprises task starting time; determining whether the initialization task configuration information meets a preset condition or not, wherein the preset condition is that the current time is larger than or equal to the task starting time; in response to determining that the preset condition is met, determining whether the task corresponding to the current time is persistently stored in a preset storage system or not; in response to the situation that the task is persistently stored in the storage system, reading the task through a preset external table in the storage system; and executing the task according to the initialized task configuration information. According to the embodiment, the date parameter is dynamically adjusted along with the change of the task execution time, the data access step is simplified, and the data access efficiency is improved.

Description

technical field [0001] The embodiments of the present disclosure relate to the field of computer technology, and in particular, to a task processing method, device, electronic device, and computer-readable medium. Background technique [0002] With the application of artificial intelligence technology in all walks of life in society, the demand for artificial intelligence algorithms and models has also shown exponential growth. At present, when the system processes tasks, the processing method usually adopted is: according to different data sources, data source connection configuration is performed to realize data source access to different data calculation engines; after data calculation is completed, different connections are required Configure information to realize the connection with the data storage system, and write the data result. [0003] However, the following technical problems may exist in the above method: [0004] First, it is impossible to dynamically adjus...

AI Technical Summary

Problems solved by technology

[0004] First, it is impossible to dynamically adjust the date parameters as the task execution time changes; different connection configuration information is required to realize the connection with the data storage system, resulting in cumbersome steps for data access and reducing the efficiency of data access;

[0005] Second, the execution progress of the task is not recorded, so that when the task execution is interrupted, the task cannot be quickly re-executed, which reduces the robustness of the system

Images