Anti-turbulence long-distance pickup method and device and readable storage medium thereof

Abstract

The invention provides an anti-turbulence long-distance pickup method and device and a readable storage medium. In the method, laser generated by a laser is regulated and controlled by a half-wave plate and transmitted light is transmitted and received to realize echo collection; reflected local oscillation light and echoes are processed by a series of optical elements, a digital micromirror device, a wavefront sensor, a deformable mirror and the like and then are subjected to coherent beam splitting in a polarization beam splitter to enter a coherent receiver, a calculation unit processes signals to obtain sound information, and meanwhile, the self-adaptive optical technology is used for resisting turbulence, and the single exposure technology is used for improving the frame rate. The device comprises a laser generation and modulation module, a signal acquisition and conduction module, a signal processing and restoration module, a self-adaptive optical correction module, a frame rate improvement adaptation module and the like. The invention solves the problems of short pickup distance, large turbulence influence and the like in the prior art, realizes long-distance turbulence-resistant pickup, and is suitable for the fields of public safety, criminal investigation and case handling and the like.

Description

Technical Field

[0001] The present invention relates to the field of sound pickup technology, and in particular to a method and device for long-distance sound pickup with anti-turbulence capability and a readable storage medium thereof. Background Art

[0002] In the field of public security and criminal investigation, sound pickup technology is crucial, providing key support for monitoring potential risks, collecting evidence and solving cases. However, existing technologies have many limitations in practical applications.

[0003] Some traditional solutions, such as CN103000184B, require the deployment of microphones, routers, and wireless transmission equipment in the target sound pickup area. This model is not only cumbersome to install and costly, but also in scenarios such as temporary monitoring and covert listening, the equipment deployment is easy to expose the target and is restricted by the environment. The flexibility and concealment are poor, which greatly limits its universality and emergency response capabilities.

[0004] CN107301869B and CN108109617B also use microphone arrays to pick up sounds. Although they can capture sounds at a distance of tens of meters, the energy of sound waves decays exponentially when propagating in the air, making it difficult to expand the sound pickup range. In scenarios such as large-area monitoring and long-distance target listening, the performance drops sharply, and cannot meet the needs of long-distance and precise sound pickup, limiting the breadth and depth of technical applications.

[0005] Although CN113686425A adopts laser long-distance sound pickup technology, it has not overcome the problem of turbulence interference in laser transmission. In harsh environments with large temperature gradients and strong winds, the laser wavefront is severely distorted by turbulence and the coherence is sharply weakened, making it difficult for local coherent receivers to accurately restore the phase of acoustic information, resulting in signal loss or distortion, seriously affecting the reliability and stability of sound pickup, greatly weakening the adaptability and practical value of the technical environment, and failing to provide solid guarantees for safe law enforcement under complex working conditions.

[0006] Therefore, there is an urgent need for a turbulence-resistant long-distance sound pickup method, device and readable storage medium thereof to solve the problems existing in the prior art. Summary of the invention

[0007] The embodiments of the present invention provide a turbulence-resistant long-distance sound pickup method, device and readable storage medium thereof, which address the problems existing in current technologies, such as complex target area deployment, limited sound pickup distance, poor reliability due to environmental (such as turbulence) influences, and inability to meet the needs of public safety and criminal investigation for long-distance, flexible and stable sound pickup.

[0008] The core technology of this invention is to collect sound in the target area with laser coherence measurement technology and wrap it in the laser light field phase, compensate for the influence of laser transmission turbulence with adaptive optics technology, and use single exposure technology to improve the frame rate of the wavefront sensor and the adaptive optics closed-loop correction bandwidth, so as to achieve anti-turbulence long-distance sound pickup.

[0009] In a first aspect, the present invention provides a turbulence-resistant long-distance sound pickup device, the method comprising: Laser generation and modulation module, used to generate linearly polarized single-frequency laser and adjust the polarization direction of the laser, thereby controlling the energy distribution ratio of the transmitted and reflected optical paths; The signal acquisition and transmission unit is used to split the reflected local oscillator light and perform characteristic monitoring, adjustment and coherent processing to extract the local oscillator light data; it is used to change the polarization state of the transmitted light beam, transmit and receive echoes and perform coherent processing; The signal processing and restoration component is used to extract the phase information of the reflected local oscillator light and the coherent data of the transmitted light beam according to the photocurrent equation, the detector parameters and the filtering operation to obtain the sound data; The adaptive optical correction module is used to monitor the reflected local oscillator light and the echo wavefront to obtain distortion information and calculate the correction amount of the deformable mirror to achieve real-time dynamic correction of wavefront distortion and effectively combat turbulence interference in laser transmission.

[0010] Furthermore, it also includes a frame rate improvement adaptation module for implementing single exposure encoding through a deep learning algorithm.

[0011] Furthermore, the laser generation and modulation module is composed of a laser and a half-wave plate. The laser is responsible for generating linearly polarized single-frequency laser, and the half-wave plate is used to accurately control the polarization direction of the laser, thereby controlling the energy distribution ratio of the subsequent optical path.

[0012] Furthermore, the signal collection and transmission unit is composed of a polarization beam splitter, a beam splitter, a digital micromirror device, a wavefront sensor, a deformable mirror, a reflector, a quarter wave plate and a transceiver antenna; so as to realize efficient collection and transmission of sound signals from the outside to the core processing components, forming a stable signal link; The polarization beam splitter sets the splitting according to the half-wave plate of the laser generation and modulation module, and guides the light beam to different paths to build a signal acquisition framework; the transceiver antenna realizes signal reception and transmission; the digital micromirror device, wavefront sensor, deformable mirror and reflector work together through optical reflection and refraction to ensure stable signal transmission and effective processing of local oscillator light and signal light; the quarter-wave plate improves the optical path by accurately changing the polarization state.

[0013] Furthermore, the signal processing and restoration component is composed of a coherent receiver and a computing unit. The coherent receiver converts the optical signal into an electrical signal, and the computing unit deeply processes the electrical signal and restores it into sound information based on a preset algorithm, a photocurrent equation and detector parameter characteristics.

[0014] Furthermore, the adaptive optical correction module is composed of a wavefront sensor, a deformable mirror and a computing unit. The wavefront sensor monitors the reflected local oscillator light and the echo wavefront to obtain distortion information. The computing unit calculates the correction amount of the deformable mirror according to the algorithm. The deformable mirror dynamically corrects the wavefront distortion in real time to effectively counteract the turbulence interference of laser transmission.

[0015] Furthermore, the frame rate improvement adaptation module includes a digital micromirror device and a computing unit, and the computing unit runs a deep learning algorithm to drive the digital micromirror device to implement single exposure encoding.

[0016] In a second aspect, the present invention provides a control method for a turbulence-resistant long-distance sound pickup device, comprising the following steps: S00, using the laser of the laser generation and modulation module to generate linearly polarized single-frequency laser, adjusting the polarization direction through a half-wave plate to control the ratio of transmitted and reflected light energy, and building a laser energy distribution infrastructure; S10, the transmitted light beam obtains the target echo through the pre-built transmitting-receiving circuit, and the reflected local oscillator light is coherently split with the echo signal light in the polarization beam splitter and introduced into the coherent receiver, forming a complete path from the sound source to the signal processing front end; S20, the coherent receiver converts the signal and processes it in the computing unit, extracting the phase information to obtain the sound data according to the photocurrent equation, the detector parameters and the filtering operation; S30, using a wavefront sensor to measure the local oscillator light and the echo wavefront, and a computing unit to calculate the correction amount of the deformable mirror according to the difference between the two to counter turbulence, and to dynamically optimize the optical path distortion in real time; S40. Using single exposure encoding of digital micromirror devices combined with deep learning algorithms to improve the frame rate of wavefront sensors to match deformable mirrors.

[0017] In a third aspect, the present invention provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the above-mentioned control method.

[0018] In a fourth aspect, the present invention provides a readable storage medium, in which a computer program is stored. The computer program includes a program code for controlling a process to execute the process, and the process includes the control method according to the above.

[0019] The main contributions and innovations of the present invention are as follows: 1. Long-distance sound pickup capability is significantly improved The present invention uses laser coherent measurement technology to collect sound near the target area, overcoming the problem of limited sound pickup distance caused by sound wave energy attenuation in traditional microphone arrays, achieving sound pickup at longer distances, and greatly expanding the sound pickup range. It shows outstanding advantages in scenarios such as large-area monitoring and long-distance target listening, and meets the needs of public safety and criminal investigation for long-distance sound monitoring.

[0020] 2. Effectively combat turbulence interference Adaptive optics technology is introduced to accurately detect the local oscillator light and echo wavefront information through the wavefront sensor. The computing unit calculates and controls the deformable mirror to correct the impact of turbulence on the wavefront in real time, ensuring that the system can still maintain a high coherence when the laser is transmitted in harsh environments (such as large temperature gradients and strong winds), thereby stably restoring the phase information with target sound information. This solves the problem of low reliability of sound pickup in turbulent environments with existing laser pickup technology and enhances the applicability and stability of the system in complex environments.

[0021] 3. Improve frame rate and optimize system performance With the help of single exposure technology and digital micromirror devices, the wavefront is encoded at high speed, and a deep learning algorithm is used to improve the frame rate of the wavefront sensor to match the frame rate of the deformable mirror, optimize the closed-loop correction bandwidth of adaptive optics, accelerate the system response speed, and improve the system's ability to adapt to dynamic scenes and complex optical changes, ensuring that sound can be picked up accurately and efficiently in a rapidly changing environment, further improving the overall performance of the system and the accuracy of sound pickup.

[0022] The details of one or more embodiments of the invention are set forth in the following drawings and description so that other features, objects, and advantages of the invention are more readily apparent. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings: Figure 1 is a process of a turbulence-resistant long-distance sound pickup method according to an embodiment of the present invention; Figure 2 is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present invention; In the figure, 1, laser; 2, first half-wave plate; 3, first polarization beam splitter; 4, second polarization beam splitter; 5, transceiver antenna; 6, first beam splitter; 7, first digital micromirror device; 8, first wavefront sensor; 9, first deformable mirror; 10, first reflector; 11, second half-wave plate; 12, second reflector; 13, second beam splitter; 14, second digital micromirror device; 15, second wavefront sensor; 16, second deformable mirror; 17, third reflector; 18, quarter-wave plate; 19, third polarization beam splitter; 20, third half-wave plate; 21, fourth half-wave plate; 22, first coherent receiver; 23, second coherent receiver; 24, analog-to-digital converter; 25, computing unit. DETAILED DESCRIPTION

[0024] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with one or more embodiments of this specification. Instead, they are merely examples of devices and methods consistent with some aspects of one or more embodiments of this specification as detailed in the appended claims.

[0025] It should be noted that: in other embodiments, the steps of the corresponding method are not necessarily performed in the order shown and described in this specification. In some other embodiments, the steps included in the method may be more or less than those described in this specification. In addition, a single step described in this specification may be decomposed into multiple steps for description in other embodiments; and multiple steps described in this specification may be combined into a single step for description in other embodiments.

[0026] Existing sound pickup technology has problems such as complex deployment in the target area, limited pickup distance, and poor reliability due to environmental influences (such as turbulence). It cannot meet the needs of public safety and criminal investigation for long-distance, flexible and stable pickup.

[0027] Based on this, the present invention solves the problems existing in the prior art based on laser coherence measurement technology.

[0028] Embodiment 1 The present invention aims to provide a turbulence-resistant long-distance sound pickup device, which can, in particular, refer to Figure 1 ,include: Laser generation and modulation module: It consists of laser 1 and the first half-wave plate 2. Laser 1 is responsible for generating linearly polarized single-frequency laser. The first half-wave plate 2 is used to accurately control the polarization direction of the laser, thereby controlling the energy distribution ratio of the subsequent optical path. This module is the energy source and signal basic modulation unit of the device, laying the foundation for the energy and polarization characteristics of the overall optical architecture. Its unique synergistic effect ensures that the laser characteristics are adapted to the pickup requirements and provides stable and adaptive input for subsequent complex optical processing.

[0029] Signal acquisition and transmission unit: consists of a first polarization beam splitter 3, a second polarization beam splitter 4, a first beam splitter 6, a second beam splitter 13, a first digital micromirror device 7, a second digital micromirror device 14, a first wavefront sensor 8, a second wavefront sensor 15, a first deformable mirror 9, a second deformable mirror 16, a first reflector 10, a second reflector 12, a third reflector 17, a quarter wave plate 18 and a transceiver antenna 5. Among them, the first polarization beam splitter 3 sets the splitting according to the first half-wave plate 2, guides the light beam to different paths to build a signal acquisition framework; the transceiver antenna 5 realizes signal reception and transmission; the first digital micromirror device 7, the first wavefront sensor 8, the first deformable mirror 9, the first reflector 10, the second half-wave plate 11, the second reflector 12 and the second digital micromirror device 14, the second wavefront sensor 15, the second deformable mirror 16, and the third reflector 17 cooperate through complex optical reflection and refraction to ensure stable signal transmission and effective processing of local oscillation light and signal light; the quarter-wave plate 18 accurately changes the polarization state at a specific position to improve the optical path. This unit works closely to realize the efficient collection and transmission of sound signals from the outside world to the core processing components, forming a stable signal link, which is the key architecture for the acquisition and transmission of acoustic information of the device.

[0030] Among them, the signal acquisition and transmission unit includes: ① Reflected local oscillator light processing The reflected local oscillator light is first split by the first beam splitter 6, of which 10% of the beam energy is reflected into the first digital micromirror device 7, and 90% is transmitted into the first deformable mirror 9. After being reflected by the first digital micromirror device 7, the light beam enters the first wavefront sensor 8 to obtain wavefront information, and the light beam reflected from the first deformable mirror 9 is reflected by the first reflector 10, the second half-wave plate 11, and the second reflector 12 in sequence to enter the subsequent system, and is subsequently introduced into the first coherent receiver 22 and the second coherent receiver 23 after coherent beam splitting with the echo signal light in the third polarization beam splitter 19. This process realizes the monitoring and adjustment of the local oscillator light characteristics and the effective coherent processing with the signal light through the coordination of splitting, reflection, sensing and subsequent optical elements, prepares key local oscillator light data for sound information extraction, and ensures the signal acquisition accuracy and system stability. The coordinated processing of each component is the key link in building a complete sound pickup system and subsequent precise acoustic processing. If it is missing, the system functional integrity and performance reliability will be affected.

[0031] ②Transmitted beam processing After the transmitted light beam is transmitted through the second polarization beam splitter 4, it passes through the quarter wave plate 18. After its polarization state is changed, it is emitted to the target surface by the transceiver antenna 5. The target reflected echo is then received by the transceiver antenna 5 and enters the system. After the echo passes through the quarter wave plate 18, the polarization mode is converted from horizontal polarization to vertical polarization, and then it is reflected by the second polarization beam splitter 4 and enters the subsequent system. Here, the second polarization beam splitter 4 splits the light, 10% of the light beam energy is reflected into the second digital micromirror device 14, and 90% is transmitted into the second deformable mirror 16. The reflected light is reflected by the second digital micromirror device 14 and enters the second wavefront sensor 15 to monitor the wavefront. The transmitted light is reflected by the second deformable mirror 16 and the third reflector 17, and then enters the subsequent system and is coherently processed with the local oscillator light. This process accurately controls the polarization and path of the light beam, realizes signal reception and transmission, polarization state conversion on demand, and coordinated processing with the local oscillator light, ensures the stable and efficient collection and transmission of external sound signals, and provides a high-quality signal foundation for acoustic information restoration. The accuracy and stability of the coordinated operation of its optical components are directly related to the system's sound pickup effect and anti-interference ability.

[0032] Signal processing and restoration component: With the first coherent receiver 22, the second coherent receiver 23 and the computing unit 25 as the core, the first coherent receiver 22 and the second coherent receiver 23 convert the optical signal into an electrical signal. The computing unit 25 deeply processes the signal to restore the sound information according to the preset algorithm, the photocurrent equation and the detector parameter characteristics. This component serves as the acoustic function realization terminal of the device, accurately analyzes and processes the optical signal, realizes the accurate reproduction from the light field fluctuation to the sound signal, determines the accuracy and practicality of the device's sound pickup, and is the core processing hub of sound pickup.

[0033] Adaptive optical correction module: It is coordinated by the first wavefront sensor 8, the second wavefront sensor 15, the first deformable mirror 9, the second deformable mirror 16 and the computing unit 25. The first wavefront sensor 8 monitors the local oscillator light and the second wavefront sensor 15 monitors the echo wavefront to obtain distortion information. The computing unit 25 calculates the correction amount of the first deformable mirror 9 and the second deformable mirror 16 according to the algorithm. The first deformable mirror 9 and the second deformable mirror 16 dynamically correct the wavefront distortion in real time, effectively counteract the turbulent interference of laser transmission, maintain the stability of the optical path to ensure the reliability of sound pickup. This module gives the device the ability to adapt to harsh environments and stable acoustic performance, strengthens the anti-interference ability of sound pickup from system feedback control, and improves the overall technical competitiveness.

[0034] Frame rate improvement adaptation module: includes the first digital micromirror device 7, the second digital micromirror device 14 and the computing unit 25. The computing unit 25 runs a deep learning algorithm to drive the first digital micromirror device 7 and the second digital micromirror device 14 to implement single exposure encoding, which greatly improves the frame rate of the first wavefront sensor 8 and the second wavefront sensor 15 to match the first deformable mirror 9 and the second deformable mirror 16, optimizes the adaptive optical closed-loop bandwidth, and enhances the dynamic response performance of the system. This module improves the response speed and stability of the device to complex dynamic environments from the perspective of system performance optimization, ensures efficient and accurate sound pickup, expands the breadth and depth of the device's application scenarios, and strengthens the overall functional advantages.

[0035] In this embodiment, if Figure 1 As shown, the optical path of this scheme is described as follows: Laser 1 emits a single-frequency laser with linear polarization. After passing through the first half-wave plate 2, the polarization direction of the linear polarization rotates to a certain extent, which is used to control the proportion of light energy transmitted and reflected by the first polarization beam splitter 3, generally reflecting 10% and transmitting 90% of the beam energy.

[0036] The light beam transmitted through the first polarization beam splitter 3 is transmitted through the second polarization beam splitter 4 and then through the quarter wave plate 18, and is emitted to the target surface through the transceiver antenna 5. The echo reflected from the target is received by the transceiver antenna 5 and enters the system. After passing through the quarter wave plate 18, the polarization mode is converted from horizontal polarization to vertical polarization, and is reflected through the second polarization beam splitter 4 to enter the subsequent system.

[0037] The light beam reflected by the first polarization beam splitter 3 is used as the local oscillator light of the system, and is split by the first beam splitter 6. 10% of the light beam energy is reflected into the first digital micromirror device 7, and 90% of the light beam energy is transmitted into the first deformable mirror 9. After the first digital micromirror device 7 reflects the light beam, the light beam enters the first wavefront sensor 8. After the first deformable mirror 9 reflects the light beam, it is reflected by the first reflector 10, passes through the second half-wave plate 11, and is reflected by the second reflector 12 into the subsequent system.

[0038] The light beam reflected by the beam splitter 4 is the received echo containing the target sound information. It is split by the second beam splitter 13, 10% of the light beam energy is reflected into the second digital micromirror device 14, and 90% of the light beam energy is transmitted into the second deformable mirror 16. After the second digital micromirror device 14 reflects the light beam, the light beam enters the second wavefront sensor 15. After the second deformable mirror 16 reflects the light beam, it is reflected by the third reflector 17 and enters the subsequent system.

[0039] The light beam reflected by the second reflector 12 is called local oscillator light, and its polarization direction is at an angle of 45 degrees to the horizontal. The light beam reflected by the third reflector 17 is called signal light, and its polarization direction is at an angle of 45 degrees to the horizontal. The local oscillator light and the signal light are split after coherence in the third polarization beam splitter 19. One path of light passing through the third polarization beam splitter 19 passes through the third half-wave plate 20 and enters the second coherent receiver 23. The other path of light passing through the third polarization beam splitter 19 passes through the fourth half-wave plate 21 and enters the first coherent receiver 22.

[0040] The first coherent receiver 22 and the second coherent receiver 23 convert analog signals into digital signals through an analog-to-digital converter (ADC) 24 , and then the computing unit 25 collects and processes the data.

[0041] The first digital micromirror device 7 , the second digital micromirror device 14 , the first wavefront sensor 8 , the second wavefront sensor 15 , the first deformable mirror 9 , and the second deformable mirror 16 are connected to the computing unit 25 via a USB bus.

[0042] In the present invention, the analog-to-digital converter (ADC) plays a bridging role. After the analog optical signal received by the coherent receiver is converted into a digital signal, it can be input into the computing unit for subsequent data processing and sound information extraction and restoration operations, thereby realizing the complete process of the entire long-distance sound pickup system from optical signal acquisition to final sound output.

[0043] Preferably, the computing unit of the present invention may be an existing computer or a cloud server.

[0044] Preferably, the process of laser acquiring sound is as follows: The light field output by the laser is expressed as , is the amplitude intensity of the light field, is the complex amplitude representation of the light field, and are the coefficients of the amplitude components in the x and y directions, is the phase modulation function of the incident light. The angle between the fast axis of the first half-wave plate 2 and the x-axis is , the angle between the fast axis of the second half-wave plate 11, the third half-wave plate 20, and the fourth half-wave plate 21 and the x-axis is , the angle between the fast axis of the quarter wave plate 18 and the x-axis is .

[0045] The photocurrent equation output by the first coherent receiver 22 is:

[0046] is the responsivity of the photodetector, is the photocurrent output by channel 1 of the first coherent receiver 22, is the photocurrent output by channel 2 of the first coherent receiver 22, is the quantum conversion efficiency of channel 1 of the first coherent receiver 22, is the quantum conversion efficiency of channel 2 of the first coherent receiver 22, is the phase information containing the sound information, The fixed phase is brought to the detector of the first coherent receiver 22.

[0047] , Generally equal, use Indicates that the above formula is simplified to:

[0048] The photocurrent equation output by the second coherent receiver 23 is:

[0049] is the photocurrent output by channel 1 of the second coherent receiver 23, is the photocurrent output by channel 2 of the second coherent receiver 23, is the quantum conversion efficiency of channel 1 of the second coherent receiver 23, is the quantum conversion efficiency of channel 2 of the second coherent receiver 23, The fixed phase of the second coherent receiver 23 detector , Generally equal, use Indicates that the above formula is simplified to:

[0050] By filtering out the DC component, the same batch of PD detectors and Consistent, use Indicates that the phase can be solved:

[0051] is the photocurrent of the detector of the second coherent receiver 23, The photocurrent phase of the detector of the first coherent receiver 22 is:

[0052] This phase is proportional to the tiny displacement caused by the sound in the target area. Obtaining this phase information means obtaining the sound information of the target area.

[0053] The PD detector mentioned above comes from the first coherent receiver 22 and the second coherent receiver 23 , and the PD detector here can be a PIN (photodiode) or an APD (avalanche photodiode).

[0054] Preferably, the single exposure principle is as follows: Since the frame rates of the first wavefront sensor 8 and the second wavefront sensor 15 are much lower than the frame rates of the first deformable mirror 9 and the second deformable mirror 16, and this difference is generally 10 to 100 times, in order to match the frame rates of the wavefront sensor and the deformable mirror and optimize the closed-loop bandwidth of the adaptive optical system, the first digital micromirror device 7 and the second digital micromirror device 14 are introduced to encode the wavefront at high speed, and the frame rate of the wavefront sensor is increased by 10 to 100 times through the single exposure technology, thereby meeting the high-speed adaptive correction process. The specific method is that the digital micromirror device encodes 10 to 100 times within one exposure time of the wavefront sensor, and through the deep learning algorithm of EfficientSCI, 10 to 100 actual images are restored from one exposure image of the wavefront sensor, thereby achieving the effect of improving the frame rate.

[0055] The first digital micromirror device 7 and the second digital micromirror device 14 are based on microelectromechanical system (MEMS) technology, and their micromirror arrays are composed of numerous tiny independently controllable reflector units. Each micromirror unit can quickly change the reflection angle under the control of an electrical signal, usually switching between the two states of "on" (+θ angle, such as +12°) and "off" (-θ angle, such as -12°), thereby reflecting the incident light in different directions and realizing the modulation of the optical signal. The specific high-speed encoding process is as follows: ① Coding strategy formulation According to the system requirements and wavefront sensor characteristics, a specific coding sequence is designed. For example, in a wavefront sensor exposure time (set as T), it is divided into N equal time intervals (N=10-100), and in each interval, the micromirror unit of the digital micromirror device changes the reflection angle according to the preset coding mode.

[0056] ②Optical signal modulation and wavefront coding In each time interval, when the incident light is reflected by the digital micromirror device, the reflected light produces different phase or intensity changes due to the different states (on / off) of the micromirror unit, thereby encoding the wavefront information. For example, for a specific wavefront phase distribution, the reflected light forms a corresponding coding pattern through a specific on / off combination of the micromirror unit of the digital micromirror device. The pattern carries the wavefront information and forms N different coding states in N consecutive time intervals, corresponding to N different wavefront coding information.

[0057] The EfficientSCI algorithm (or similar algorithms) based on deep learning plays a key role. The algorithm uses a large amount of pre-training data to learn the relationship between the coding state of the digital micromirror device and the actual change of the wavefront, and establishes a mapping model from the coded image to the actual wavefront image. After the wavefront sensor performs an exposure to obtain an image containing the coding information of the digital micromirror device, the trained image reconstruction algorithm model is input. Based on the learned mapping relationship, the model analyzes the characteristics of the coded image and restores N different actual wavefront images (N=10-100) corresponding to N time intervals, thereby increasing the frame rate of the wavefront sensor by 10-100 times. For example, a traditional wavefront sensor can only obtain one frame of image within a time T. After combining the digital micromirror device encoding with single exposure technology, 10-100 frames of actual images can be obtained within the same time T, achieving a significant increase in frame rate, meeting the system's requirements for high-speed adaptive correction, and optimizing system performance.

[0058] Preferably, the principle of adaptive optics is as follows: The first wavefront sensor 8 detects the wavefront information of the local oscillator light. Since the wavefront information of the laser 1 is different, some lasers have better wavefronts and some lasers have worse wavefronts. The first wavefront sensor 8 can record the wavefront state of the laser beam before emission.

[0059] The second wavefront sensor 15 detects the wavefront information of the echo light beam, and the wavefront records the influence of the turbulence encountered by the laser beam during the transmission process.

[0060] The wavefront recorded by the first wavefront sensor 8 is subtracted from the wavefront recorded by the second wavefront sensor 15 to obtain the influence of turbulence on the wavefront. The execution amount of the deformable mirror is calculated by the calculation unit and sent to the first deformable mirror 9 and the second deformable mirror 16 for correction. This cycle is repeated continuously to achieve real-time wavefront distortion correction and achieve anti-turbulence effect.

[0061] Embodiment 2 Based on the same concept, the present invention also proposes a control method for a turbulence-resistant long-distance sound pickup device, comprising: S00, using laser to generate linearly polarized single-frequency laser, adjusting the polarization direction through a half-wave plate to control the ratio of transmitted and reflected light energy, and building a basic framework for laser energy distribution; S10, the transmitted light beam obtains the target echo through the pre-built transmitting-receiving circuit, and the reflected local oscillator light is coherently split with the echo signal light in the polarization beam splitter and introduced into the coherent receiver, forming a complete path from the sound source to the signal processing front end; S20, the coherent receiver converts the signal and processes it in the computing unit, extracting the phase information to obtain the sound data according to the photocurrent equation, the detector parameters and the filtering operation; S30, using a wavefront sensor to measure the local oscillator light and the echo wavefront, and a computing unit to calculate the correction amount of the deformable mirror according to the difference between the two to counter turbulence, and to dynamically optimize the optical path distortion in real time; S40. Using single exposure encoding of digital micromirror devices combined with deep learning algorithms to improve the frame rate of wavefront sensors to match deformable mirrors.

[0062] In this embodiment, the present invention uses the deep learning algorithm of EfficientSCI to recover 10 to 100 actual images from a single exposure image of the wavefront sensor, thereby improving the frame rate of the wavefront sensor to match the deformable mirror. The specific steps are as follows: 1) Data preparation stage Collect a large number of single exposure images of wavefront sensors under different turbulence conditions and sound scenes and the corresponding multiple frames of actual images (10-100 times) as training data sets. For example, simulate various sound sources in different wind speed and temperature change environments and record wavefront sensor data at the same time.

[0063] Preprocess the image data, including normalization, denoising and other operations, to improve data quality and feature recognition, and provide high-quality input for neural network training.

[0064] 2) Model construction and training The EfficientSCI deep learning model suitable for the present invention is constructed, including multiple convolutional layers, pooling layers, and fully connected layers. The convolutional layer is used to extract local features of the image, the pooling layer reduces the dimension and reduces the amount of calculation, and the fully connected layer integrates the features and maps them to the output image space.

[0065] The training data is input into the model, and the model parameters are optimized through the back propagation algorithm. The loss function can be selected as mean square error (MSE), etc., to measure the difference between the predicted image and the actual image, guide the model to learn to reduce the error, until the model converges and accurately establishes the image mapping relationship.

[0066] 3) Practical image restoration application After the wavefront sensor acquires an image through an exposure, it is input into the trained EfficientSCI model.

[0067] Based on the learned mapping relationship, the model outputs the corresponding 10-100 actual image estimates. For example, in actual monitoring scenarios, when faced with a single exposure image disturbed by turbulence, the model can generate a series of high-frame rate images to accurately restore the wavefront changes caused by the sound, thereby achieving accurate extraction of sound information and meeting the needs of long-distance sound pickup in anti-turbulence.

[0068] The EfficientSCI algorithm is based on a deep learning framework and uses the powerful feature learning and pattern recognition capabilities of neural networks. Its core principle is to build a complex network structure to learn the optical information features and patterns contained in the wavefront sensor exposure image, and establish a mapping relationship from a single exposure image to multiple actual images, thereby achieving frame rate improvement.

[0069] Preferably, the following deep learning algorithms can also be applied to the present invention for improving the frame rate: Convolutional Neural Network (CNN): It can effectively reduce the dimension of large amounts of images and retain image features. It is often used in image classification, retrieval, target location detection, etc.

[0070] Recurrent Neural Networks (RNNs) and their variants, such as Long Short-Term Memory (LSTM) and Gated Recurrent Units (GRUs), can effectively process sequence data and are suitable for tasks such as text generation, speech recognition, and machine translation.

[0071] Generative Adversarial Networks (GANs): Generative models are trained through game theory, consisting of a generator and a discriminator, which can generate realistic samples.

[0072] Reinforcement Learning (RL): Learning optimal strategies by interacting with the environment. It can be combined with deep neural networks for decision-making and control in complex environments.

[0073] Autoencoders: Used to learn low-dimensional representations of data, by compressing the input data into hidden layers and reconstructing the original data to achieve dimensionality reduction and feature extraction.

[0074] Variational Autoencoders: introduces latent variables and variational inference, which can be used for tasks such as generating samples and image synthesis.

[0075] Deep Reinforcement Learning: Combines deep learning and reinforcement learning for generative learning tasks in complex environments.

[0076] Embodiment 3 This embodiment also provides an electronic device, referring to Figure 2 , comprises a memory 404 and a processor 402, wherein the memory 404 stores a computer program, and the processor 402 is configured to run the computer program to execute the steps in any of the above method embodiments.

[0077] Specifically, the processor 402 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiment of the present invention.

[0078] Among them, the memory 404 may include a large capacity memory 404 for data or instructions. For example, but not limitation, the memory 404 may include a hard disk drive (HDD), a floppy disk drive, a solid state drive (SSD), a flash memory, an optical disk, a magneto-optical disk, a tape, or a universal serial bus (USB) drive, or a combination of two or more of these. In appropriate cases, the memory 404 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 404 may be inside or outside the data processing device. In a specific embodiment, the memory 404 is a non-volatile memory. In a specific embodiment, the memory 404 includes a read-only memory (ROM) and a random access memory (RAM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (Programmable Read-Only Memory, PROM for short), an erasable PROM (Erasable Programmable Read-Only Memory, EPROM for short), an electrically erasable PROM (Electrically Erasable Programmable Read-Only Memory, EEPROM for short), an electrically alterable ROM (Electrically Alterable Read-Only Memory, EAROM for short) or a flash memory (FLASH) or a combination of two or more of these. In appropriate circumstances, the RAM may be a static random access memory (SRAM) or a dynamic random access memory (DRAM), wherein the DRAM may be a fast page mode dynamic random access memory 404 (FPMDRAM), an extended data output dynamic random access memory (EDODRAM), a synchronous dynamic random access memory (SDRAM), etc.

[0079] The memory 404 may be used to store or cache various data files required for processing and / or communication, as well as possible computer program instructions executed by the processor 402 .

[0080] The processor 402 reads and executes the computer program instructions stored in the memory 404 to implement any one of the turbulence-resistant long-distance sound pickup methods in the above embodiments.

[0081] Optionally, the electronic device may further include a transmission device 406 and an input / output device 408 , wherein the transmission device 406 is connected to the processor 402 , and the input / output device 408 is connected to the processor 402 .

[0082] The transmission device 406 can be used to receive or send data via a network. The specific examples of the above-mentioned network may include a wired or wireless network provided by a communication provider of the electronic device. In one example, the transmission device includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 406 can be a radio frequency (Radio Frequency, referred to as RF) module, which is used to communicate with the Internet wirelessly.

[0083] Input / output devices 408 are used to input or output information.

[0084] Embodiment 4 This embodiment further provides a readable storage medium, in which a computer program is stored. The computer program includes a program code for controlling a process to execute the process. The process includes the anti-control method according to the second embodiment.

[0085] It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementation modes, and this embodiment will not be described in detail here.

[0086] In general, various embodiments may be implemented in hardware or dedicated circuits, software, logic, or any combination thereof. Some aspects of the invention may be implemented in hardware, while other aspects may be implemented in firmware or software executed by a controller, microprocessor, or other computing device, but the invention is not limited thereto. Although various aspects of the invention may be shown and described as block diagrams, flow charts, or using some other graphical representation, it should be understood that, as non-limiting examples, the boxes, devices, systems, techniques, or methods described herein may be implemented in hardware, software, firmware, dedicated circuits or logic, general-purpose hardware or controllers or other computing devices, or some combination thereof.

[0087] Embodiments of the present invention can be implemented by computer software, which is executable by a data processor of a mobile device, such as in a processor entity, or implemented by hardware, or implemented by a combination of software and hardware. Computer software or programs (also referred to as program products) including software routines, applets and / or macros can be stored in any device readable data storage medium, and they include program instructions for performing specific tasks. Computer program products can include one or more computer executable components configured to perform embodiments when the program is running. One or more computer executable components can be at least one software code or a part thereof. In addition, at this point, it should be noted that any box of the logic flow can represent a program step, or interconnected logic circuits, boxes and functions, or a combination of program steps and logic circuits, boxes and functions. Software can be stored in physical media such as memory chips or storage blocks implemented in processors, magnetic media such as hard disks or floppy disks, and optical media such as, for example, DVDs and data variants thereof, CDs. Physical media are non-transient media.

[0088] Those skilled in the art should understand that the technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0089] The above embodiments only express several implementation methods of the present invention, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present invention. It should be pointed out that, for those of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the attached claims.

Claims

1. A turbulence-resistant long-distance sound pickup device, characterized in that: include: Laser generation and modulation module, used to generate linearly polarized single-frequency laser and adjust the polarization direction of the laser, thereby controlling the energy distribution ratio of the transmitted and reflected optical paths; A signal collection and transmission unit, used to split the reflected local oscillator light and perform characteristic monitoring, adjustment and coherent processing to extract local oscillator light data; Used to change the polarization state of the transmitted light beam, transmit and receive echoes, and perform coherent processing; The signal processing and restoration component is used to extract the phase information of the reflected local oscillator light and the coherent data of the transmitted light beam according to the photocurrent equation, the detector parameters and the filtering operation to obtain the sound data; The adaptive optical correction module is used to monitor the reflected local oscillator light and the echo wavefront to obtain distortion information and calculate the correction amount of the deformable mirror to achieve real-time dynamic correction of wavefront distortion and effectively combat turbulence interference in laser transmission.

2. The anti-turbulence long-distance sound pickup device according to claim 1, characterized in that: It also includes a frame rate up-conversion module for implementing single-exposure encoding via deep learning algorithms.

3. The anti-turbulence long-distance sound pickup device as claimed in claim 1, characterized in that: The laser generation and modulation module is composed of a laser and a half-wave plate. The laser is responsible for generating linearly polarized single-frequency laser, and the half-wave plate is used to accurately adjust the polarization direction of the laser, thereby controlling the energy distribution ratio of the subsequent optical path.

4. The anti-turbulence long-distance sound pickup device as claimed in claim 1, characterized in that: The signal collection and transmission unit is composed of a polarization beam splitter, a beam splitter, a digital micromirror device, a wavefront sensor, a deformable mirror, a reflector, a quarter wave plate and a transceiver antenna; so as to realize efficient collection and transmission of sound signals from the outside to the core processing components, and form a stable signal link; The polarization beam splitter sets the splitting according to the half-wave plate of the laser generation and modulation module, and guides the light beam to different paths to build a signal collection framework; the transceiver antenna realizes signal transmission and reception; the digital micromirror device, wavefront sensor, deformable mirror and reflector work together through optical reflection and refraction to ensure stable signal transmission and effective processing of local oscillator light and signal light; The quarter wave plate improves the optical path by precisely changing the polarization state.

5. The anti-turbulence long-distance sound pickup device as claimed in claim 1, characterized in that: The signal processing and restoration component is composed of a coherent receiver and a computing unit. The coherent receiver converts the optical signal into an electrical signal, and the computing unit deeply processes the electrical signal and restores it into sound information based on a preset algorithm, a photocurrent equation and detector parameter characteristics.

6. The anti-turbulence long-distance sound pickup device as claimed in claim 1, characterized in that: The adaptive optical correction module is composed of a wavefront sensor, a deformable mirror and a computing unit. The wavefront sensor monitors the reflected local oscillator light and the echo wavefront to obtain distortion information. The computing unit calculates the correction amount of the deformable mirror according to the algorithm. The deformable mirror dynamically corrects the wavefront distortion in real time to effectively counteract the turbulence interference of laser transmission.

7. The anti-turbulence long-distance sound pickup device as claimed in claim 2, characterized in that: The frame rate improvement adaptation module includes a digital micromirror device and a computing unit, and the computing unit runs a deep learning algorithm to drive the digital micromirror device to implement single exposure encoding.

8. A control method for a turbulence-resistant long-distance sound pickup device according to any one of claims 1 to 7, characterized in that: The following steps are involved: S00, using the laser of the laser generation and modulation module to generate linearly polarized single-frequency laser, adjusting the polarization direction through a half-wave plate to control the ratio of transmitted and reflected light energy, and building a laser energy distribution infrastructure; S10, the transmitted light beam obtains the target echo through the pre-built transmitting-receiving circuit, and the reflected local oscillator light is coherently split with the echo signal light in the polarization beam splitter and introduced into the coherent receiver, forming a complete path from the sound source to the signal processing front end; S20, the coherent receiver converts the signal and processes it in the computing unit, extracting the phase information to obtain the sound data according to the photocurrent equation, the detector parameters and the filtering operation; S30, using a wavefront sensor to measure the local oscillator light and the echo wavefront, and a computing unit to calculate the correction amount of the deformable mirror according to the difference between the two to counter turbulence, and to dynamically optimize the optical path distortion in real time; S40. Using single exposure encoding of digital micromirror devices combined with deep learning algorithms to improve the frame rate of wavefront sensors to match deformable mirrors.

9. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to run the computer program to perform the control method of claim 8 .

10. A readable storage medium, characterized in that: The readable storage medium has stored therein a computer program including a program code for controlling a process to execute a process including the control method according to claim 8 .

Images