Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Task scheduling method based on deep reinforcement learning in hierarchical edge computing environment

A task scheduling and edge computing technology, applied in the computer field, can solve problems affecting mobile application experience, long data transmission delay, etc., and achieve the effects of low overhead, reduced service delay, and improved quality

Active Publication Date: 2021-12-10
CHONGQING UNIV OF TECH
View PDF2 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, remote offloading tasks require a long data transmission delay, which affects the experience of mobile applications after task offloading, especially for delay-sensitive mobile applications, such as: voice recognition and control, video image recognition, interactive games, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task scheduling method based on deep reinforcement learning in hierarchical edge computing environment
  • Task scheduling method based on deep reinforcement learning in hierarchical edge computing environment
  • Task scheduling method based on deep reinforcement learning in hierarchical edge computing environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] Embodiments of the technical solutions of the present invention will be described in detail below in conjunction with the accompanying drawings. The following examples are only used to illustrate the technical solutions of the present invention more clearly, and therefore are only examples, rather than limiting the protection scope of the present invention.

[0061] It should be noted that, unless otherwise specified, the technical terms or scientific terms used in this application shall have the usual meanings understood by those skilled in the art to which the present invention belongs.

[0062] like figure 1 As shown, the scenario of the present invention is applicable to the edge network scenario. The mobile application offloads its own resource-intensive tasks to the edge cloud through the nearby connected base station (Base station, BS). Understand the current available IT resources for each edge service node. After the task is offloaded to the edge cloud, CC r...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a task scheduling method based on deep reinforcement learning in a hierarchical edge computing environment. The method comprises the following steps: establishing a neural network model based on Sequence-to-Sequence (Seq2Seq), and applying the model to solve mapping from an optimal task to an edge service node to serve as a neural network structure in an intelligent agent; training the model by adopting a deep reinforcement learning method based on Monte Carlo strategy gradient, so that the model has a self-learning capability and a capability of optimizing a task scheduling decision; and deploying a task scheduling algorithm fusing neural network solution and a heuristic algorithm in the system, so that the quality of a scheduling decision can be remarkably improved, and the efficiency and the quality can be balanced.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to an edge computing environment in which service nodes are deployed hierarchically according to the distance from a mobile client. In the face of task request dynamics and edge service node resource heterogeneity, a depth-based A learned approach to intelligent task scheduling. Background technique [0002] With the rapid development and large-scale deployment of cloud computing, more and more mobile applications offload their computing-intensive tasks to cloud data centers. Effectively reduce the overhead of local resources. [0003] However, remote offloading tasks require a long data transmission delay, which affects the experience of mobile applications after task offloading, especially for delay-sensitive mobile applications, such as: voice recognition and control, video image recognition, interactive games, etc. . In order to reduce latency and improve mobile application...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50G06N3/02G06N3/08
CPCG06F9/5072G06F9/4806G06F9/4881G06N3/02G06N3/08Y02D10/00
Inventor 陈卓卫佩宏
Owner CHONGQING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products