Unlock instant, AI-driven research and patent intelligence for your innovation.

A task processing method, device, storage medium and electronic device

A task processing and task technology, applied in reasoning methods, multi-programming devices, electrical digital data processing, etc., can solve problems such as tail delay, and achieve the effect of reducing tail delay

Active Publication Date: 2022-07-19
SHENZHEN UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In view of this, the embodiments of the present invention provide a task processing method, device, storage medium and electronic equipment to solve the technical problem of tail delay caused by task processing methods in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A task processing method, device, storage medium and electronic device
  • A task processing method, device, storage medium and electronic device
  • A task processing method, device, storage medium and electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of the present invention.

[0027] The embodiment of the present invention provides a task processing method, such as figure 1 As shown, the method includes the following steps:

[0028] Step S101 : when the to-be-processed task is received, a plurality of task fragments corresponding to the to-be-processed task are obtained in response to the fine-grained division ope...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a task processing method, device, storage medium and electronic device. The method includes: when a task to be processed is received, obtaining multiple task fragments corresponding to the task to be processed in response to a fine-grained division operation of the task to be processed; Compare the total execution time of multiple task fragments with the target time; keep pending tasks whose total execution time is less than or equal to the target time according to the comparison result, and discard pending tasks whose total execution time is greater than the target time; The processing tasks are prioritized according to the characteristics of the task fragments and respond to the task processing operations according to the sorting results. According to the characteristics of task fragments, the tasks to be processed are sorted and processed according to their priorities, which fully considers the urgency of the tasks to be processed and reduces the tail delay; considers the target deadline of the tasks to be processed, and uses fine-grained division to predict the time of the tasks to be processed. , execute pending tasks within the target deadline, reducing tail latency.

Description

technical field [0001] The invention relates to the technical field of machine learning inference scheduling, and in particular to a task processing method, device, storage medium and electronic device. Background technique [0002] With the popularity of machine learning, inference models are increasingly appearing on the critical path of network requests, and machine learning inference is becoming a core building block for interactive applications. Existing Model Serving architectures use common reactive techniques to mitigate common sources of latency. A common scheduling approach is by employing a method of batching tasks, but this approach results in unfinished tasks being processed. , Low-priority tasks are processed ahead of high-priority tasks, resulting in tail delays. SUMMARY OF THE INVENTION [0003] In view of this, embodiments of the present invention provide a task processing method, apparatus, storage medium, and electronic device to solve the technical pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/48G06N5/04
CPCG06F9/4843G06F9/4881G06N5/04
Inventor 徐小雯王毅陈家贤马晨琳周池毛睿
Owner SHENZHEN UNIV