Directional antenna ad hoc network neighbor discovery method based on SARSA (lambda) algorithm

A neighbor discovery, directional antenna technology, applied in wireless communication, complex mathematical operations, network data management and other directions, can solve the problems of low efficiency of random algorithms, inappropriate wireless ad hoc networks, increased node power consumption, etc. Large state and action space, low power consumption, and the effect of speeding up discovery

Pending Publication Date: 2021-06-22
THE 22ND RES INST OF CHINA ELECTRONICS TECH GROUP CORP
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, it is mainly divided into random algorithm and planning algorithm. The random algorithm is inefficient and is greatly affected by different network structures. The planning algorithm needs to be coordinated by a centr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Directional antenna ad hoc network neighbor discovery method based on SARSA (lambda) algorithm
  • Directional antenna ad hoc network neighbor discovery method based on SARSA (lambda) algorithm
  • Directional antenna ad hoc network neighbor discovery method based on SARSA (lambda) algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] Example 1, such as image 3 As shown, the present embodiment discloses a method for discovering neighbors in a directional antenna ad hoc network based on the SARSA (λ) algorithm, including the following steps:

[0036] Step 1: At the beginning of the neighbor discovery process, each node initializes its own Q matrix and randomly selects the initial state s 0 (transmit / receive mode) and initial action a 0 (antenna beam direction);

[0037] Step 2: If the node enters the transmission mode, send a HELLO message in the current time slot t; if the node enters the reception mode, the receiver monitors the messages in the current antenna beam direction, if multiple HELLO messages collide here, reward It is 1; if the HELLO message is successfully monitored, then the other party is successfully discovered, and the reward is 0; if no message is heard, the reward is 0;

[0038]

[0039] Step 3: Use the ε-greedy strategy to choose action a for the next slot t+1 (antenna bea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a directional antenna ad hoc network neighbor discovery method based on an SARSA (lambda) algorithm, and the method comprises the following steps: 1, enabling each node to initialize an own Q matrix at the beginning of a neighbor discovery process, and randomly selecting an initial state and an initial action; 2, enabling the node to enter a transmission mode and a receiving mode to carry out corresponding steps, and adopting different steps; 3, employing a greedy strategy to select the action of the next time slot; 4, calculating a one-step prediction error; 5, for all states and actions, updating a Q matrix according to a one-step prediction error; 6, entering the next time slot, returning to the step 2, and stopping until the neighbor discovery process is finished. Compared with a complete random algorithm, the ad hoc network neighbor discovery method disclosed by the invention can accumulate experience in scanning and adaptively find sectors with undiscovered neighbors, so the neighbor discovery speed is accelerated.

Description

technical field [0001] The invention belongs to the field of wireless network communication, in particular to a method for discovering neighbors in a directional antenna ad hoc network based on a SARSA (λ) algorithm in the field. Background technique [0002] The application scenarios of wireless ad hoc networks are becoming more and more complex, and directional antennas are used in them due to their advantages of long transmission distance and strong anti-interference ability. However, due to its limited beamwidth, it brings great challenges to the neighbor discovery process in the network. The SARSA(λ) algorithm can continuously accumulate experience to update the strategy according to the information scanned in the network in the past, so that it gradually converges to the optimal strategy, thus speeding up the speed of neighbor discovery. [0003] Most of the current neighbor discovery algorithms use omnidirectional antennas in the whole process or in part of the proce...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04W8/00G06F17/11G06F17/16
CPCG06F17/11G06F17/16H04W8/005
Inventor 郭兰图唐怀玉葛宪生赵同明赵亮杨凯威崔鹏程
Owner THE 22ND RES INST OF CHINA ELECTRONICS TECH GROUP CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap