Task processing method and device, server, client, system and storage medium

A task processing and server technology, applied in the field of communication, can solve the problems of low security and high threshold for the use of Slurm clusters, achieve security guarantee, reduce learning costs and use thresholds, and achieve the effect of security isolation

Pending Publication Date: 2020-02-11
GUANGZHOU NETSTAR INFORMATION TECH CO LTD
View PDF5 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a task processing method, device, server, client, system, and storage medium to solve the problems of high usage threshold and low security in existing Slurm clusters

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task processing method and device, server, client, system and storage medium
  • Task processing method and device, server, client, system and storage medium
  • Task processing method and device, server, client, system and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] figure 1 It is a flow chart of a task processing method provided by Embodiment 1 of the present invention. This embodiment of the present invention is applicable to the situation where a user submits a task to a computing cluster to run the task on the computing cluster. This method can be executed by a task processing device. The device can be realized by means of software and / or hardware, and integrated in the server executing the method, specifically, as figure 1 As shown, the task processing method in the embodiment of the present invention may include the following steps:

[0052] S101. Receive a task submission request sent by the client, where the task submission request includes task configuration information.

[0053]The embodiment of the present invention is applied to the scenario where the user submits the task to the server through the client, and the server submits the task to the computing cluster, where the client can be the terminal that the user submi...

Embodiment 2

[0063] figure 2 It is a flowchart of a task processing method provided by Embodiment 2 of the present invention. This embodiment of the present invention is optimized on the basis of Embodiment 1. Specifically, as figure 2 As shown, the task processing method in the embodiment of the present invention may include the following steps:

[0064] S201. Receive a task submission request sent by the client, where the task submission request includes task configuration information.

[0065] In the embodiment of the present invention, the client can send a task submission request to the server in the form of an http request, and the task submission request includes task configuration information, and the configuration information can include selection information whether the task is submitted to the ONLINE queue or the OFFLINE queue, the Resource information of the CPU resources and memory resources required by the task, information about the longest running time of the task, etc. ...

Embodiment 3

[0096] image 3 It is a flow chart of a task processing method provided by Embodiment 3 of the present invention. This embodiment of the present invention is optimized on the basis of Embodiment 1. Specifically, as image 3 As shown, the task processing method in the embodiment of the present invention may include the following steps:

[0097] S301. Receive a task submission request sent by the client, where the task submission request includes task configuration information.

[0098] S302. Generate a task submission script including the configuration information.

[0099] S303. Submit the task submission script to the computing cluster, where the computing cluster is used to run the task according to configuration information in the task submission script.

[0100] S304. Receive a task log acquisition request sent by the client, where the task log acquisition request includes a task index identifier of the task.

[0101] Specifically, the client may generate a task log acq...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a task processing method and a device, a server, a client, a system and a storage medium, and the task processing method comprises the steps: receiving a tasksubmission request sent by the client, and the task submission request comprises the configuration information of a task; generating a task submission script containing configuration information; andsubmitting the task submission script to a computing cluster, wherein the computing cluster is used for running the task according to the configuration information in the task submission script. According to the method of the invention, task submission is divided into a client and a server; a user only needs to configure configuration information during task running at a client; a user does not need to deeply learn meanings of various parameters of the computing cluster; therefore, on one hand, the learning cost of the user and the threshold that the user uses the computing cluster are reduced, and on the other hand, the user realizes safe isolation between the computing cluster and the user side through indirect reaction between the computing cluster and the server, and a guarantee is provided for the security of the computing cluster.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of communications, and in particular, to a task processing method, server, client, system, and storage medium. Background technique [0002] With the development of information recommendation technology, online real-time recommendation has gradually become a research hotspot in the field of recommendation. The key to real-time recommendation systems lies in the update speed of models in big data scenarios, and models are usually updated through computing clusters. [0003] Take an MPI cluster deployed with an MPI (Message Passing Interface) environment as an example. After the programmer develops the program, he needs to submit the task to the MPI cluster to run. At present, the MPI cluster itself does not have the resource scheduling function. MPI The cluster manages and schedules the resources of the MPI cluster through Slurm (Simple Linux Utility for Resource Management). Slurm i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5027
Inventor 梁家彪陈航张志彪
Owner GUANGZHOU NETSTAR INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap