Internet of Vehicles cloud computing resource optimization method based on reinforcement learning

A technology of resource optimization and reinforcement learning, applied in data exchange network, digital transmission system, electrical components, etc., can solve the problems of not being able to obtain the optimal solution of real-time resource allocation, affecting user QoE, ignoring the time-varying characteristics of wireless channels, etc.

Active Publication Date: 2020-09-25
华路易云科技有限公司
View PDF4 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] The above literatures have achieved certain effects on the joint optimal allocation of communication resources and computing resources, but they have ignored the time-varying characteristics of wireless channels, which will affect the transmission efficiency of services, and then affect the QoE of users, so they cannot obtain Optimal solution for overall real-time resource allocation of the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Internet of Vehicles cloud computing resource optimization method based on reinforcement learning
  • Internet of Vehicles cloud computing resource optimization method based on reinforcement learning
  • Internet of Vehicles cloud computing resource optimization method based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] The present invention will be described in further detail below in conjunction with the accompanying drawings and specific implementation methods.

[0072] The present invention uses a virtual unit (VU) to represent the smallest unit of resources in the entire vehicle cloud system, including computing and storage resources required to process vehicle service requests in the vehicle cloud system.

[0073] figure 1 The vehicle cloud system with resource reservation strategy and resource secondary allocation mechanism is shown. When a service request arrives and the system has no available VUs for allocation, the system can select some services from the cloud and release a small amount of resources to allocate to the newly arrived service request to meet the requirements of the newly arrived service. Sometimes when there are a lot of idle resources in the cloud, the resources occupied by some services in the system can be increased to improve QoE. And when the system res...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an Internet of Vehicles cloud computing resource optimization method based on reinforcement learning. The method specifically comprises the steps of carrying out the modeling of an Internet of Vehicles system resource distribution problem as a semi-Markov decision process SMDP, and introducing a resource reservation strategy and a resource secondary distribution mechanism;and solving the model by using reinforcement learning. According to the invention, the system is enabled to obtain the optimal scheme of Internet of Vehicles resource allocation, and the resource utilization rate, the system QoS and the user QoE are improved.

Description

technical field [0001] The invention belongs to the optimization application field of the Internet of Vehicles, and in particular relates to a method for optimizing cloud computing resources of the Internet of Vehicles based on reinforcement learning. Background technique [0002] With the rapid development of the Internet of Things, its role in the industrial field is becoming more and more prominent. As one of the important applications in the industrial field, the Industrial Internet of Things (IIoT) aims to collect and process data in industrial environments to realize intelligent operations, such as industrial monitoring, automation and automatic control, etc. In IIoT, data collected from various devices needs to be collected and processed in a timely, reliable and efficient manner. To meet the stringent requirements of the IIoT, advanced communication and computing technologies are expected to play an important role. However, IIoT still faces many technical problems ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08H04L12/911
CPCH04L67/12H04L47/821H04L67/51H04L67/60H04L47/83
Inventor 洪鑫涛梁宏斌张宗源
Owner 华路易云科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap