Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Routing method for underwater acoustic network based on information importance and q-learning algorithm

A learning algorithm and underwater acoustic network technology, applied in the field of underwater acoustic network, can solve problems such as energy voids, long multi-hop transmission paths, and many dead relay nodes, and achieve the effects of shortening the range, reducing the number of explorations, and saving running time

Active Publication Date: 2022-04-05
XIAMEN UNIV +1
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] With the development of machine learning, in view of the advantages of the Q-learning algorithm, Hu et al. (T.Hu, et al. QELAR: AMachine-Learning-Based Adaptive Routing Protocol for Energy-Efficient and Lifetime-Extended Underwater Sensor Networks[J].IEEE Trans .on MobileComputing, 2010, 9(6): 796-809) used Q-learning algorithm for routing optimization of multi-diving underwater acoustic sensor network, which improved energy efficiency and extended network life, but the corresponding routing nodes would be due to It is frequently selected due to its optimality, which in turn causes the problem of energy holes in the network
Zhang Deqian et al. (Zhang Deqian, et al. A new algorithm for adaptive mobile Internet of Things routing based on Q-Learning strategy [J]. Electronic Journal, 2018, 46(10): 23-30) using Q-learning algorithm for mobile Internet of Things Routing Design Based on Data Importance Rating in Underwater Acoustic Sensor Networks [C].In Proc.of IEEE ICSPCC 2020,Taipa,Macau,China,Aug.21-23,2020) proposed to classify the information importance of underwater acoustic data, and then implement multi-diving underwater acoustic sensor network based on different importance levels route selection, but the selected multi-hop transmission path is longer and there are many dead relay nodes, the present invention will combine Q learning algorithm to effectively solve these problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Routing method for underwater acoustic network based on information importance and q-learning algorithm
  • Routing method for underwater acoustic network based on information importance and q-learning algorithm
  • Routing method for underwater acoustic network based on information importance and q-learning algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0069] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0070] In the multi-diving underwater acoustic sensor network, the present invention takes the information importance level as the first priority condition and the remaining energy of the relay node as the second priority condition, and uses the Q learning algorithm to select the best route, on the one hand, it can balance the overall energy of the system consumption, avoiding the problem of energy holes, and prolonging the life cycle of the underwater acoustic communication network; on the other hand, it can ensure that important information can be transmitted to the surface base station in an accurate and timely manner. Specifically include the following steps:

[0071] 1) In the underwater acoustic sensor network, including N s source node S i (i=1,2,...,N s ), N R relay node R i’ (i'=1,2,3,...,N R ) and 1 surface base station BS, su...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an underwater acoustic network routing selection method based on information importance and Q-learning algorithm, relating to underwater acoustic networks. Introduce the importance of information into the multi-diving underwater acoustic sensor network, take the level of information importance as the first priority condition, and take the remaining energy of relay nodes as the second priority condition, and use the Q learning algorithm to select the best route: the level of information importance is high Select a shorter route to ensure that important information is quickly and accurately transmitted to the surface base station; for information with a lower level of information importance, select a relay node with sufficient remaining energy to avoid repeated use of some relay nodes , causing the node to die too fast and energy voids to appear. The number of nodes selected for the Q-learning algorithm is only 1 / 7 of the total number of surviving nodes in the entire network, avoiding the exploration of surviving nodes in the entire network, shortening the range of candidate node sets for the Q-learning iterative algorithm, and reducing the number of explorations required to find the best route. Save algorithm running time, save power consumption of underwater nodes, and extend the life cycle of underwater acoustic networks.

Description

technical field [0001] The invention relates to an underwater acoustic network, in particular to an underwater acoustic network routing selection method based on information importance and Q learning algorithm. Background technique [0002] With the proposal and development of the concept of smart ocean, in order to alleviate the shortage of terrestrial resources, the exploration and development of marine resources using underwater acoustic sensor networks has gradually become an important research direction. [0003] In the harsh marine environment, due to the difficulty and cost of sensor node battery replacement, the energy efficiency of underwater sensor nodes has always been a challenging key issue in the design of underwater acoustic sensor networks. Studies have shown that the technical means of realizing long-distance transmission through multi-hop transmission can reduce the overall energy consumption of the underwater acoustic sensor network system (W. Zhang, et al...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04W40/10H04W40/22H04W84/18H04B13/02G06F30/18G06F30/27G06F111/02G06F111/04
CPCH04W40/10H04W40/22H04W84/18H04B13/02G06F30/18G06F30/27G06F2111/02G06F2111/04Y02D30/70
Inventor 陈友淦熊长静朱建英张檬张小康陈东升许肖梅
Owner XIAMEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products