Internet of Vehicles calculation unloading method and system based on multi-objective reinforcement learning

A technology of computing offloading and reinforcement learning, which is applied in neural learning methods, computing, transmission systems, etc., can solve the problems of less delay, long battery life, and the inability to effectively improve the efficiency of computing offloading in the Internet of Vehicles, achieving less delay and energy efficiency. Consumption, to achieve the effect of energy consumption

Pending Publication Date: 2022-01-21
XI AN JIAOTONG UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

To make matters worse, user needs may change over time, for example, some in-vehicle applications require less latency when emergency events are detected and longer battery life when no events are detected, Unable to effectively improve the computing offloading efficiency of the Internet of Vehicles

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Internet of Vehicles calculation unloading method and system based on multi-objective reinforcement learning
  • Internet of Vehicles calculation unloading method and system based on multi-objective reinforcement learning
  • Internet of Vehicles calculation unloading method and system based on multi-objective reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0101] According to the characteristics of 4G cellular network, the present invention sets the task size as [50, 1000] KB by establishing a complete calculation offloading scheme. The number of CPU cycles required for each task is [0.2, 1] Gigacycles, and the CPU frequency of MEC is [1.5, 4.5] GHz. When the bandwidth is 10MHz, the transmission rate of the MU can be determined according to Shannon's formula. In the case of noise power of -172dBm, the transmission power is 10dBm. This experiment uses TensorFlow 1.10 and Python 3.5 on Centos 7.9 to implement the RMDDQN-Learning offloading algorithm (RBF-based multi-objective DDQNreinforcement learning computation offloading algorithm). For comparison, we compare it with other benchmark algorithms. They are NSGA-II: Improved Fast Elite Non-Dominated Sorting Genetic Algorithm, that is, using genetic algorithm for the compromise of multiple objectives in the MEC network, using multi-objective Q-learning algorithm based on Chebyshev...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an Internet of Vehicles calculation unloading method and system based on multi-objective reinforcement learning, and the method comprises the steps: carrying out the multi-objective optimization of a cost model according to the cost of a vehicle calculation unloading process through employing an RMDDQN-Learning method, and obtaining a Pareto optimal solution of the multi-objective optimization; optimizing a plurality of optimization targets involved in the calculation unloading process of the vehicle at the same time, and learning the decision value of each target based on the learning method of the RBF neural network, so that the weight of each target is better and dynamically adjusted. The purpose of multi-objective optimization is to realize energy consumption, task delay, RSU load balance and privacy security of an unloading task by jointly considering an unloading decision and allocation of computing resources, and by optimizing and computing a plurality of indexes of unloading, the unloading time delay and energy consumption of vehicles in the Internet of Vehicles are kept at a relatively low basic level, the resource-limited equipment can unload the computation-intensive task to the edge equipment, so that a unique delay-limited service quality guarantee is provided for wide businesses.

Description

technical field [0001] The present invention relates to the field of computing offloading and resource allocation in the Internet of Vehicles driven by a 5G network, and specifically relates to a method and system for computing offloading in the Internet of Vehicles based on multi-objective reinforcement learning. Background technique [0002] As one of the most promising technologies in the 5G era, the traditional ad hoc network of vehicles is rapidly developing towards the Internet of Vehicles (IoV). In-vehicle applications and services are becoming more and more abundant (such as autonomous driving, video-assisted real-time navigation, augmented reality, etc.), and these applications are often computationally intensive, energy-intensive, and low-latency applications. However, the limited computing power of the on-board computing unit has become the bottleneck of these applications, making it difficult to meet the low-latency real-time requirements. Mobile edge computing ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/61G06F9/445G06F9/50G06N3/08H04L67/12
CPCG06F8/62G06F9/44594G06F9/5083G06N3/08H04L67/12Y02D10/00
Inventor 伍卫国张祥俊柴玉香杨诗园
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products