Underwater multi-agent-oriented Q learning ant colony routing method

A multi-agent, ant colony algorithm technology, applied in electrical components, wireless communication, network topology, etc., can solve the problems of unstable link, poor adaptability of dynamic topology, etc., and achieve the effect of good convergence speed and robustness

Active Publication Date: 2020-04-24
TSINGHUA UNIV
View PDF3 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] Aiming at the problems of poor adaptability to dynamic topology and unstable links in traditional underwater routing protocol

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Underwater multi-agent-oriented Q learning ant colony routing method
  • Underwater multi-agent-oriented Q learning ant colony routing method
  • Underwater multi-agent-oriented Q learning ant colony routing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] Preferred embodiments of the invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the invention, and are not intended to limit the protection scope of the invention.

[0043] It should be noted that, in the description of the invention, terms such as "upper", "lower", "left", "right", "inner", "outer" and other indicated directions or positional relationships are based on the terms shown in the accompanying drawings. Orientation or positional relationship, which is only for convenience of description, and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as a limitation on the invention.

[0044] In addition, it should be noted that, in the description of the invention, unless otherwise clearly stipulated an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an underwater multi-agent-oriented Q learning ant colony routing method, which is combined with reinforcement learning and ant colony algorithm to adapt to and learn characteristics of a dynamic underwater environment, and comprises the following steps of: a routing discovery stage, a routing maintenance stage and a routing hole processing mechanism. Pheromones in the ant colony algorithm are mapped into a Q value in Q learning. The delay and bandwidth of links and the residual energy and throughput of nodes are comprehensively considered as a Q value function to selecta next hop link. A routing protocol also realizes a hole sensing mechanism. ACK return time is recorded through node timing broadcast and a timer. Whether the nodes are in a routing holes are judged,and the network is prevented from using the nodes in the hole through a penalty function of Q learning. The energy and depth of the nodes and the link stability are considered, the end-to-end delay ofthe nodes is reduced through Q learning, the data delivery rate is increased, and the service life of the underwater wireless sensor network is prolonged.

Description

technical field [0001] The invention relates to the field of routing protocols for underwater sensor networks, in particular to a routing protocol for underwater sensor networks based on Q-learning and clustering algorithms. Background technique [0002] Despite the strategic importance of ocean exploration and development, only 5% of the ocean has ever been explored. This is partly due to the fact that ocean hydroacoustic channels are very different from wireless channels over water. Therefore, the wireless routing algorithm on land cannot be directly applied to underwater sensor networks (UWSNs), it must be modified to be used in underwater situations. [0003] Compared with terrestrial wireless sensor networks, underwater sensor networks (UWSNs) face the following challenges: [0004] (1) High delay caused by sound as a signal propagation medium. Due to the serious attenuation of electromagnetic wave signals under water, it can only be used for short-distance transmiss...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04W40/10H04W40/12H04W40/22H04W40/24H04W84/18
CPCH04W40/10H04W40/12H04W40/22H04W40/248H04W84/18
Inventor 任勇王景璟方政儒
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap