Task execution method, device and server

A task execution and task configuration technology, applied in the computer field, can solve problems such as oversized projects, inconvenient task management, and duplication of cleaning task codes, and achieve the effects of simple tasks, reduced code duplication, and concise and convenient code maintenance.

Active Publication Date: 2018-07-13
深圳市中兴通讯技术服务有限责任公司
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a task execution method, device and server to solve at least one of the problems of traditional cleaning task code duplication, oversized project, and inconvenient task management

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task execution method, device and server
  • Task execution method, device and server
  • Task execution method, device and server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] Such as figure 1 As shown, an embodiment of the present invention provides a task execution method, including:

[0031] Step S110, read the task description file corresponding to the task. The task description file records the path of the database public package used to execute the task, the path of the database script file used to represent the entity of the task, and the first parameter corresponding to the task. A parameter is used to replace variables in the database script file. In this embodiment, the task description file may be in xml format, the database script file may be in sql format, the tasks performed include but not limited to data cleaning tasks, and the database public package may be a public jar package.

[0032] Step S120, pushing the database script file to the computing node, where the computing node has the database public package.

[0033] Step S130, call the database public package according to the path of the database public package, obtain t...

Embodiment 2

[0036] Such as figure 2 As shown, an embodiment of the present invention provides a task execution method, including:

[0037]Step S210, read the task description file corresponding to the task. The task description file records the path of the database public package used to execute the task, the path of the database script file used to represent the entity of the task, and the first parameter corresponding to the task. One parameter is used to replace the variables in the database script file. The path of the task configuration file is also recorded in the task description file. The second parameter used to replace the threshold value of the database script file is recorded in the task configuration file. The task description file includes the task The information of the corresponding input table and the information of the output table.

[0038] In this embodiment, an original task consists of three parts: a task.xml file, a task.sql file, and a task.conf file (can be omit...

Embodiment 3

[0045] Such as image 3 As shown, an embodiment of the present invention provides a task performance device, including:

[0046] The reading module 310 reads the task description file corresponding to the task, the path of the database public package used to execute the task, the path of the database script file used to represent the entity of the task, and the first parameter corresponding to the task are recorded in the task description file , the first parameter is used to replace variables in the database script file. In this embodiment, the task description file may be in xml format, the database script file may be in sql format, the tasks performed include but not limited to data cleaning tasks, and the database public package may be a public jar package.

[0047] The push module 320 pushes the database script file to the computing node, and the computing node has the database public package.

[0048] The execution module 330 calls the database public package according...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a task execution method, device and a server. The task execution method comprises the following steps: reading a task description file corresponding to a task, wherein the taskdescription file is recorded with a path for executing a database public packet of the task, a path for representing a database script file of an entity of the task, and a first parameter corresponding to the task, and the first parameter is used for replacing variables in the database script file; pushing the database script file to a computing node, wherein a database public packet is arrangedat the computing node; calling the database public packet according to the path of the database public packet; acquiring the database script file and replacing variables in the database script file byusing the first parameter, and executing the database script file to obtain an execution result of the task through the database public packet and according to the path of the database script file. According to the task execution method, device and the server, code repetition is greatly reduced, the task becomes simpler, and the labor is saved.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a task execution method, device and server. Background technique [0002] Spark is a big data processing framework built around speed, ease of use, and complex analysis: through the lower-cost Suffle (data cleaning algorithm) method in the data processing process, MapReduce (a programming model) is raised to a higher level level; using in-memory data storage and near real-time processing capabilities, its performance is many times faster than other big data processing technologies. [0003] Traditional data cleaning tasks often require the development of a large number of codes to support them. When there are many cleaning tasks, the project package will often become bloated, which will bring various disadvantages. For example: 1. The code repetition rate is high and the waste of manpower is serious. When the project is very large, there will be a considerable portion...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/36G06F9/44
CPCG06F8/73G06F11/3628G06F9/44G06F11/36
Inventor 单立明钟陈练匡林林
Owner 深圳市中兴通讯技术服务有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap