Supercharge Your Innovation With Domain-Expert AI Agents!

Reinforcement learning adaptive stochastic resonance method for underwater weak signal detection

A weak signal detection and stochastic resonance technology, applied in neural learning methods, genetic laws, biological neural network models, etc., can solve problems such as signal damage and achieve the effect of enhancing weak signals

Inactive Publication Date: 2017-02-15
XIAMEN UNIV
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Some traditional signal detection methods, such as matched filtering, coherent detection, and classical spectrum analysis, all use the method of suppressing noise. damage
Therefore, under the strong noise background of the underwater acoustic channel, especially for the in-band noise in the same frequency band as the signal, these signal detection techniques are helpless

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Reinforcement learning adaptive stochastic resonance method for underwater weak signal detection
  • Reinforcement learning adaptive stochastic resonance method for underwater weak signal detection
  • Reinforcement learning adaptive stochastic resonance method for underwater weak signal detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The invention provides a method for detecting underwater weak signals by using an adaptive stochastic resonance system based on reinforcement learning. Using the mechanism of reinforcement learning, combined with genetic algorithm, the accurate system parameters required to achieve stochastic resonance under different noise environments are obtained, so as to realize the enhancement of weak underwater signals.

[0022] In the bistable stochastic resonance system, the Brownian particles tend to move under the action of a nonlinear potential field U(x), the graph is shown in figure 1 .

[0023]

[0024] Potential function (let a=1, b=1)

[0025] Deriving the potential function to obtain the external potential field force, that is

[0026] f(x)=-U'(x)=ax-bx 3 (2)

[0027] The external driving force is composed of three parts: the external potential field force f(x), the driving signal s(t), and the noise n(t), namely

[0028]

[0029] Let f(x)=0, three solution...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A reinforcement learning adaptive stochastic resonance method for underwater weak signal detection comprises the following steps: 1, calculating the signal to noise ratio of a signal before the signal enters a stochastic resonance system; 2, coding possible solutions of parameters a and b of the stochastic resonance system, forming a gene space, and segmenting the gene space into n sub-spaces; 3, creating n Agents, taking the n sub-spaces as action spaces of the n Agents, and initializing each Q value; 4, determining a Q-Learning action and obtaining experience knowledge and a training example; 5, calculating the signal to noise ratio every time and using the signal to noise ratio for evaluation of individual fitness and as an environment reward to update the Q value and carrying out elite retention; 6, determining whether a termination condition is satisfied, outputting the parameters a and b of the round as the optimal parameters if the termination condition is satisfied, or repeating from the action selection step 4 if not satisfied; and 7, using the optimal parameters a and b to achieve the optimal stochastic resonance effect, and calculating the signal to noise ratio of an output signal of the system. If the output signal to noise ratio is greater than the input signal to noise ratio, it is proved that the weak signal is enhanced.

Description

technical field [0001] The invention relates to underwater acoustic communication, and is a reinforcement learning self-adaptive stochastic resonance method for underwater weak signal detection. Background technique [0002] The underwater acoustic communication channel is a time-varying, space-varying, and frequency-varying fading channel with serious noise interference. After the signal passes through the underwater acoustic channel, it is often submerged by a large amount of noise or interference and becomes a weak signal. The underwater acoustic signal detection technology has important significance and application value no matter in theoretical research, practical engineering or even national defense construction. Therefore, it is necessary to study the detection method of weak signals for the progress and development of underwater acoustic communication. [0003] Some traditional signal detection methods, such as matched filtering, coherent detection, and classical sp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/08G06N3/12
CPCG06N3/126G06N3/08
Inventor 袁飞季舒瑶程恩陈柯宇朱逸
Owner XIAMEN UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More