Internet of vehicles edge computing task unloading method based on hierarchical reinforcement learning

An edge computing and reinforcement learning technology, applied in neural learning methods, constraint-based CAD, computing, etc., can solve NP-hard problems and achieve the effect of excellent performance and low joint loss function
CN113568675APending Publication Date: 2021-10-29广东利通科技投资有限公司 +1
0 Cites 19 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
广东利通科技投资有限公司
Publication Date
2021-10-29

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention belongs to the technical field of Internet of Vehicles edge computing, and particularly relates to an Internet of Vehicles edge computing task unloading method based on hierarchical reinforcement learning. Firstly, a task unloading problem in an edge computing network of the Internet of Vehicles is modeled as an optimization problem with a minimum delay-energy consumption-cost joint loss function as a target, wherein optimization parameters are a task execution sequence, a computing decision, local resource allocation and transmission power control; then, the application with task relevance is expressed in the form of a directed acyclic graph, implicit features in the application are mined through a graph neural network, and meanwhile the discrete continuous mixed action space is processed through a layered reinforcement learning algorithm; and a simulation experiment is carried out by taking the automobile speed adopted in a real environment as a data set, and a result shows that compared with a heuristic algorithm, the method disclosed by the invention can adaptively adjust task unloading and resource allocation strategies under various environmental parameters, so that a system loss function is more effectively reduced.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention belongs to the technical field of edge computing of the Internet of Vehicles, and in particular relates to a task offloading method for edge computing of the Internet of Vehicles based on layered reinforcement learning. Background technique

[0002] With the continuous development of the Internet of Vehicles, applications such as assisted driving, augmented reality, and image processing have been gradually deployed in vehicle equipment to improve the driving experience of people in the vehicle [1]. These applications usually have two characteristics: large demand for computing resources and high real-time requirements. However, in-vehicle devices have limited computing resources and limited energy supply, which often cannot meet the demands of these applications [2].

[0003] By introducing cloud servers with powerful computing capabilities, mobile cloud computing (Mobile Cloud Computing, MCC) is regarded as an effective way to solve the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More