Internet of things (IoT) error sensor node location method based on improved Q learning algorithm

A sensor node and learning algorithm technology, applied in network topology, energy-saving ICT, advanced technology, etc., can solve the problems of inability to accurately locate faulty nodes, single reward function, low robustness, etc., to achieve wide application value, robustness The effect of high sex and balanced energy consumption

Active Publication Date: 2013-01-09
江苏楠睿科技有限公司
View PDF3 Cites 43 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Compared with the traditional Q-learning, the one-dimensional state-action pair only solves the routing problem of the wireless sensor network, the reward function is relatively single and fixed, and the error node cannot be accurately located, which requires additional energy consumption of the sensor node. Less robustness when sensor network topology changes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Internet of things (IoT) error sensor node location method based on improved Q learning algorithm
  • Internet of things (IoT) error sensor node location method based on improved Q learning algorithm
  • Internet of things (IoT) error sensor node location method based on improved Q learning algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the technical means, creative features, goals and effects achieved by the present invention easy to understand, the present invention will be further described below in conjunction with specific embodiments.

[0031] figure 1In order to implement the sensing layer layout of the wireless sensor network of the present invention, the present invention adopts the layout of multi-Sink sink nodes. The dotted line in the figure is an unstable communication link. It is assumed that the position of each sensor node is unknown, and only the coordinate position of the source node is known. When the energy state and route selection of the wrong node change, how to adaptively calculate the route and locate the node is the focus of the research of the present invention. By improving the traditional Q-learning method, the calculated Q-value can adaptively change the characteristic information such as the remaining energy of the sensor node, routing selection, and tran...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an internet of things (IoT) error sensor node location method based on an improved Q learning algorithm. The method is characterized in that the traditional Q learning method is improved to make calculated Q values adaptively change according to characteristic information such as residual energy of a sensor node, routing and transmission hop count, a routing path is established by means of a maximal Q value, meanwhile, a background server works out a network topological structure, when the node is attached or produces error data, an error range is set by comparison with the Q value of the node of the next period, and when the range is exceeded, the node is judged to be the error node and is located. According to the invention, extra energy of the sensor node does not need to be consumed, and when a wireless sensor network topological structure changes, higher robustness is also achieved; and the method has the advantages of intelligent property, low energy consumption, high adaptive degree and the like, can be used to not only routing, location and energy consumption performance evaluation of the sensor node but also accurate location of unknown error nodes, and has wide application values.

Description

technical field [0001] The invention belongs to the field of Internet of things public security, and in particular relates to an improved reinforcement learning algorithm applied to error node positioning of a wireless sensor network. Background technique [0002] The Internet of Things (The Internet of Things) is a new system of real-time interaction between the virtual network and the real world. Its ubiquitous data perception, wireless-based information transmission, and intelligent information processing are conducive to improving social efficiency. , but it also arouses the public's attention to information security and privacy protection issues. Among them, the wireless sensor network (Wireless Sensor Network, WSN) is an important part of the Internet of Things. The sensor nodes are exposed in the public. Compared with the wired network, the wireless sensor network is more vulnerable to various security threats, such as node Victimization, routing destruction, error m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04W4/06H04W40/02H04W64/00H04W84/18
CPCY02B60/50Y02D30/70
Inventor 范新南卞辉史鹏飞张继
Owner 江苏楠睿科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products