Satellite Internet of Things routing strategy based on Q-Learning

A technology of the Internet of Things and satellites, applied in network topology, data exchange network, digital transmission system, etc., can solve the problems of difficult routing algorithms and inapplicable routing algorithms of ground networks, and achieve good conversion application prospects, average delay and good cost effect

Active Publication Date: 2020-10-13
NANJING UNIV OF POSTS & TELECOMM
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

These limitations make the routing algorithm of the terrestrial network unsuitable for the satellite Internet of Things, and make it very difficult to design an efficient routing algorithm

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Satellite Internet of Things routing strategy based on Q-Learning
  • Satellite Internet of Things routing strategy based on Q-Learning
  • Satellite Internet of Things routing strategy based on Q-Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The technical solution of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0037] The overall framework of the embodiment of the present invention can be found in figure 1 , the present invention proposes a Q-Learning-based satellite Internet of Things routing strategy, regards the Satellite Internet of Things as an environment for reinforcement learning, satellites in the Satellite Internet of Things are used as satellite nodes, sensors and data centers are used as ground nodes, and each node can meet The nodes of the network are neighbor nodes, and satellite nodes forward data packets through store-carry-forward, which can achieve efficient routing in complex environments, and have better results in terms of delivery rate, average delay and overhead. The specific steps of the embodiment of the present invention are:

[0038] Step 1: Initialize the satellite IoT parameters.

[0039] The parameters that n...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a satellite Internet of Things routing strategy based on Q-Learning. Aiming at a satellite Internet of Things routing problem in a complex environment, a satellite Internet ofThings topological structure and node state dynamic changes are considered, the whole satellite Internet of Things is regarded as a reinforcement learning environment, and satellite nodes and ground nodes are regarded as intelligent agents., A method for implementing the strategy comprises the following stepsL firstly, initializingand satellite Internet of Things parameters are initialized firstly; secondly, maintaining a Q value table by each node, and learning the Q value table by utilizing a Q value updating formula according to the hop count, the distance, the direction and the buffer areaoccupancy rate of the satellite nodes; and finally, forwarding the data packet according to a greedy selection strategy through a Q value table obtained by learning. Moreover, the reward value is improved by considering the hop count of the satellite nodes, and the discount factor is improved by considering the distance and direction of the satellite nodes and the occupancy rate of the buffer area, so that the Q value is optimized, and the purpose of efficient routing of the satellite Internet of Things is achieved. Therefore, the satellite Internet of Things routing strategy has good conversion and application prospects in the fields of aviation, spaceflight, social economy and the like.

Description

technical field [0001] The invention belongs to the technical field of computer applications, and in particular relates to a Q-Learning-based satellite Internet of Things routing strategy. Background technique [0002] The satellite Internet of Things is a combination of satellites and the Internet of Things. It not only uses satellite relays to solve communication problems, but also a ubiquitous Internet of Things system under the framework of the space-ground integrated information network. It is a comprehensive application service platform formed by the fusion of various information technologies. The satellite Internet of Things has the advantages of large coverage depth and breadth, multiple types of application services, and strong system robustness, and has attracted extensive attention from researchers. [0003] As the core of the satellite IoT communication protocol, routing technology undertakes the heavy responsibility of data transmission and determines the overa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04W40/02H04L12/733H04L12/751G06N20/00H04L29/08H04W84/06H04L45/02H04L45/122
CPCH04W40/02H04L45/08H04L45/20G06N20/00H04W84/06H04L67/12Y02D30/70
Inventor 孙力娟龚啸天周剑王娟韩崇肖甫
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap