A multi-view underwater target detection method for three-dimensional side-scan sonar
Through the multi-view angle detection method of three-dimensional side-sweep sonar, multi-beam side-sweep and digital signal processing, the problem of low detection accuracy of traditional sonar in complex environments is solved, and more efficient and accurate underwater object detection and imaging are achieved. .
Patent Information
- Application Number
- CN202411191883.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-28
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2044-08-28
AI Technical Summary
Traditional single-beam sonar has limited detection effects in complex underwater environments, and there are insufficient information and accuracy problems in the acquisition of water depth information and the construction of three-dimensional scenes, resulting in low detection accuracy of underwater targets.
Using the multi-view underwater target detection method of three-dimensional side-sweep sonar, the three-dimensional side-sweep sonar deployment and coordinate space alignment are performed by obtaining the underwater target position information, adjusting the detection orientation, performing multi-beam side-sweep, and receiving echo signals. Digital signal processing, calculate water depth information, and generate three-dimensional reconstruction images and scenes.
It improves the accuracy and efficiency of underwater target detection, provides more comprehensive underwater target information and three-dimensional imaging, and enhances the accuracy and reliability of the detection.
Smart Images

Figure CN118688809B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the technical field of sonar detection, and in particular to a multi-view underwater target detection method of a three-dimensional side-scan sonar. Background Art
[0002] Sonar technology has gradually evolved from early single-direction detection to multi-directional detection to meet the needs of multi-angle display of targets in complex underwater environments. In the second half of the 20th century, the advancement of sonar imaging technology made three-dimensional side-scan sonar gradually become a key tool for achieving high-precision underwater target imaging. With the enhancement of computing power and the development of algorithms, the multi-perspective fusion technology of sonar data has gradually matured, which can effectively integrate sonar signals from different directions to achieve more comprehensive and accurate underwater target detection and imaging. With the development of science and technology, the design of sonar sensors has been gradually optimized, including the layout of transmitters and receivers, as well as the structural optimization of arrays, thereby improving the efficiency and quality of data acquisition. At the same time, innovations in signal processing algorithms, such as multi-perspective data fusion, target motion compensation, and noise suppression, have significantly improved the accuracy and reliability of underwater target detection. In recent years, with the application of deep learning technology in sonar data processing, such as neural network-based image restoration and target recognition, the application potential of three-dimensional side-scan sonar has been further expanded, enabling it to handle more complex and changeable underwater environmental conditions. However, the detection effect of traditional single-beam sonar in complex underwater environments is limited. At the same time, the lack of information and accuracy problems in the acquisition of water depth information after sonar imaging and the construction of three-dimensional scenes lead to low accuracy in underwater target detection. Summary of the invention
[0003] Based on this, it is necessary to provide a multi-perspective underwater target detection method for three-dimensional side-scan sonar to solve at least one of the above technical problems.
[0004] To achieve the above object, a multi-perspective underwater target detection method of three-dimensional side scan sonar is provided, the method comprising the following steps:
[0005] Step S1: Acquire underwater target position information data; perform three-dimensional side-scan sonar deployment according to the underwater target position information data, thereby obtaining three-dimensional side-scan sonar deployment position information data; perform coordinate space alignment on the underwater target position information data and the three-dimensional side-scan sonar deployment position information data, and generate target-sonar center point alignment data; perform detection azimuth adjustment on the three-dimensional side-scan sonar according to the target-sonar center point alignment data, thereby generating three-dimensional side-scan sonar detection adjustment data;
[0006] Step S2: performing a three-dimensional multi-beam side scan on the underwater target based on the three-dimensional side scan sonar detection adjustment data to generate a multi-beam acoustic wave transmission signal; receiving an echo signal according to the multi-beam acoustic wave transmission signal to obtain an underwater target scanning echo signal; performing digital signal conversion on the underwater target scanning echo signal to generate an underwater target scanning digital signal;
[0007] Step S3: Acquire underwater environment data; confirm the initial and end positions of the underwater target scanning digital signal to obtain the initial point data and the end point data, calculate the water depth of the initial point data and the end point data according to the underwater environment data, and obtain the water depth information data;
[0008] Step S4: Perform three-dimensional sonar imaging on the underwater target scanning echo electrical signal to generate a three-dimensional reconstructed image of the underwater target; construct a three-dimensional scene of the target through the three-dimensional reconstructed image of the underwater target and the water depth information data, thereby generating a three-dimensional imaging picture of the underwater target.
[0009] The present invention obtains the position information of the underwater target by using a positioning system or other sensors, which is usually recorded in the form of coordinates. According to the position information of the underwater target, the deployment position of the three-dimensional side-scan sonar is determined to ensure that the sonar can effectively cover the target area. The position information data of the underwater target and the deployment position information of the three-dimensional side-scan sonar are aligned in coordinate space to ensure the consistency of the two in the same coordinate system. According to the data after the coordinate space alignment, the alignment data of the target position and the sonar center point position are generated, and these data will be used for the subsequent sonar detection azimuth adjustment. The detection azimuth of the three-dimensional side-scan sonar is adjusted using the target-sonar center point alignment data to optimize the detection efficiency and accuracy of the sonar. According to the sonar detection azimuth adjustment data in step S1, the three-dimensional side-scan sonar is adjusted to prepare for the subsequent three-dimensional multi-beam side scan. Based on the adjusted sonar detection azimuth, a multi-beam acoustic wave signal is emitted to cover the target area and obtain echo information in more directions. The echo signals from the underwater target are received using a sonar receiver array, and these signals contain the characteristic information of the underwater target. The received echo signal is subjected to digital signal processing, including filtering, amplification and digital conversion, for subsequent analysis and processing. Sensors are used to obtain relevant data of the underwater environment, such as water temperature, water quality, water flow, etc., which will affect the speed and propagation path of sound waves in the water. Based on the echo signal intensity data, a signal intensity change curve is drawn, and its peak information is analyzed to confirm the initial and end points of the echo. According to the sound wave propagation time and underwater environmental data, the water depth information of the underwater target is calculated, which can provide a more accurate description of the target location. The received echo signal is imaged using a three-dimensional side-scan sonar to generate a three-dimensional reconstructed image of the underwater target. Combined with the three-dimensional reconstructed image of the underwater target and the previously calculated water depth information, a complete three-dimensional scene of the underwater target is constructed. The constructed three-dimensional scene is transmitted to a display device or sonar platform to generate a visualized three-dimensional imaging screen of the underwater target for analysis and display, which can effectively help the detection and imaging of underwater targets and improve the efficiency and accuracy of task execution. Therefore, the present invention improves the accuracy of underwater target detection by performing multi-beam side scanning on the underwater target, utilizing phased emission, and performing rapid imaging on the underwater target.
[0010] Preferably, step S1 comprises the following steps:
[0011] Step S11: Acquire underwater target position information data;
[0012] Step S12: deploying a three-dimensional side-scan sonar according to the underwater target position information data, thereby obtaining three-dimensional side-scan sonar deployment position information data;
[0013] Step S13: performing position center point identification on the underwater target position information data and the three-dimensional side scan sonar deployment position information data, thereby generating underwater target center point position data and three-dimensional side scan sonar center point position data;
[0014] Step S14: Align the underwater target center point position data and the three-dimensional side-scan sonar center point position data in coordinate space to generate target-sonar center point alignment data; adjust the detection azimuth of the three-dimensional side-scan sonar according to the target-sonar center point alignment data to generate three-dimensional side-scan sonar detection adjustment data.
[0015] The present invention facilitates the subsequent deployment and detection of three-dimensional side-scan sonars by acquiring accurate position information of underwater targets, thereby improving the positioning accuracy of the entire system. Deploying three-dimensional side-scan sonars according to target position information data can ensure the optimal position of the sonar, thereby maximizing the detection effect and reducing blind spots. By identifying and aligning the target and sonar center point position data, the height of the sonar detection direction and the target position can be ensured to be consistent, thereby improving the accuracy of detection. The generated three-dimensional side-scan sonar detection adjustment data can adjust the detection direction of the sonar in real time so that it always points to the target, improving the detection effect and data reliability. Through data processing and integration, errors can be reduced, the overall performance of the system can be improved, and more accurate and detailed underwater environmental information can be provided.
[0016] Preferably, step S2 comprises the following steps:
[0017] Step S21: performing a three-dimensional multi-beam side scan on the underwater target through a driving transducer in the three-dimensional side scan sonar based on the three-dimensional side scan sonar detection adjustment data to generate a multi-beam acoustic wave transmission signal;
[0018] Step S22: using the receiving transducer array in the three-dimensional side-scan sonar to receive the echo signal according to the multi-beam acoustic wave transmission signal, to obtain the underwater target scanning echo signal;
[0019] Step S23: converting the underwater target scanning echo signal into an electrical signal to generate an underwater target scanning echo electrical signal;
[0020] Step S24: converting the underwater target scanning echo electrical signal into a digital signal to generate an underwater target scanning digital signal.
[0021] The present invention drives the transducer to perform three-dimensional multi-beam side scanning of underwater targets based on the adjusted detection data, thereby improving the accuracy and coverage of detection. Multi-beam technology can simultaneously transmit and receive multiple acoustic beams, greatly improving the detection efficiency and resolution, and making the detection data more detailed and comprehensive. By using the receiving transducer array to receive the echo of the multi-beam acoustic wave transmission signal, the detailed echo signal of the target can be quickly obtained to ensure the integrity and accuracy of the data. The scanning echo signal is converted into an electrical signal to facilitate subsequent signal processing and analysis, ensuring the stability and consistency of signal transmission. The electrical signal is converted into a digital signal to facilitate subsequent data processing, storage and analysis, thereby improving the utilization rate and processing efficiency of the data.
[0022] Preferably, step S21 includes the following steps:
[0023] Step S241: updating the underwater target position information data in time series based on the three-dimensional side scan sonar detection adjustment data to obtain the target point time series position update data;
[0024] Step S242: constructing a target point moving trajectory according to the target point time-series position update data to generate a target point movement route; adjusting the transmission beam angle of the three-dimensional side-scan sonar according to the target point movement route to generate three-dimensional side-scan sonar transmission angle adjustment data;
[0025] Step S243: performing distance analysis on the three-dimensional side scan sonar emission angle adjustment data and the target point movement route to generate sonar-target distance data; performing emission array element phase superposition on the three-dimensional side scan sonar through the sonar-target distance data to generate emission array element phase superposition data;
[0026] Step S244: performing multi-angle three-dimensional multi-beam scanning on the three-dimensional side-scan sonar by transmitting array element phase superposition data, thereby generating a multi-beam acoustic wave transmission signal.
[0027] The present invention can track the position change of the target in real time and ensure the timeliness and accuracy of the data by updating the time series data of the underwater target position information based on the detection adjustment data. The moving trajectory of the target point is constructed according to the updated time series data, so that the system can accurately predict the movement path of the target, and adjust the transmission beam angle of the three-dimensional side-scan sonar according to the path, thereby improving the detection efficiency and accuracy. By performing distance analysis on the transmission angle adjustment data and the movement path of the target point, the sonar-target distance data is generated. By using these data to perform phase superposition adjustment on the transmitting array element, the transmission angle and detection range of the sonar can be optimized to ensure that the sonar beam can accurately cover the target area. By performing multi-angle scanning on the three-dimensional side-scan sonar through the phase superposition data of the transmitting array element, a multi-beam sound wave transmission signal can be generated. Multi-angle scanning can cover the target area more comprehensively, obtain more detailed underwater target information, and improve the resolution and accuracy of the data.
[0028] Preferably, step S23 includes the following steps:
[0029] Step S231: optimizing the signal gain of the underwater target scanning echo signal to generate an underwater target scanning echo amplified signal;
[0030] Step S232: performing signal bandpass filtering on the underwater target scanning echo amplified signal to generate an underwater target scanning echo filtered sonar signal;
[0031] Step S233: performing high-precision analog-to-digital conversion on the underwater target scanning echo filtering sonar signal through an analog-to-digital converter to generate an underwater target scanning digitized sonar signal; performing time domain correction on the underwater target scanning digitized sonar signal to generate an underwater target scanning correction sonar signal;
[0032] Step S234: performing real-time data packaging on the underwater target scanning correction sonar signal to generate an underwater target scanning echo electrical signal.
[0033] The present invention optimizes the signal gain of the underwater target scanning echo signal to generate an amplified signal, which can enhance the strength of the echo signal, make it easier to identify and analyze in the subsequent processing process, and improve the quality and reliability of the signal. The amplified signal is band-pass filtered to remove unnecessary noise and interference, retain the main frequency components of the target echo, and generate a filtered sonar signal, which can improve the signal-to-noise ratio and ensure the accuracy of subsequent data processing. The filtered sonar signal is converted into a digital signal by an analog-to-digital converter with high precision, and the analog signal is converted into a digital signal to generate a digitized sonar signal. At the same time, the digitized signal is corrected in the time domain to correct the deviation of the signal on the time axis to ensure the time consistency and accuracy of the data. The corrected digitized sonar signal is packaged in real time to generate an underwater target scanning echo electrical signal. Real-time packaging processing can improve data transmission efficiency and ensure the integrity and synchronization of data during transmission.
[0034] Preferably, step S3 comprises the following steps:
[0035] Step S31: using sensors to obtain underwater environment data;
[0036] Step S32: performing echo signal strength analysis on the underwater target scanning digital signal to generate echo signal strength data;
[0037] Step S33: confirming the initial point data and the end point data of the echo through the echo signal strength data, and calculating the sound wave propagation time of the initial point data and the end point data according to the underwater environment data to obtain the sound wave propagation time data;
[0038] Step S34: Calculate the water depth using the echo signal strength data and the sound wave propagation time data to obtain water depth information data.
[0039] The present invention obtains underwater environmental data by using sensors to provide basic data for subsequent signal processing and analysis. Underwater environmental data includes information such as temperature, salinity, and pressure, which is helpful to accurately calculate the speed of sound wave propagation. The digital signal of the underwater target scan is subjected to echo signal strength analysis to generate echo signal strength data. By analyzing the strength of the echo signal, the characteristic information of the target object can be identified and extracted, thereby improving the accuracy of data processing. The initial point and the end point of the echo signal are determined by the echo signal strength data, and the sound wave propagation time is calculated in combination with the underwater environmental data to generate the sound wave propagation time data. This step can accurately locate the position of the target object and ensure the accuracy of the measurement. The water depth is calculated using the echo signal strength data and the sound wave propagation time data to obtain the water depth information data. The water depth calculation combines the signal strength and the propagation time, and can provide accurate water depth measurement results.
[0040] Preferably, confirming the initial point and the end point of the echo by the echo signal strength data comprises:
[0041] Draw a signal strength change curve based on the echo signal strength data; perform echo peak information analysis on the signal strength change curve to generate echo peak information data;
[0042] According to the preset peak cutting range, the signal strength change curve is segmented into signal ranges according to the echo peak information data to generate peak division range data; the peak division range data is subjected to sliding window calculation to obtain the range signal average strength; the peak division range data is initial point confirmed by the range signal average strength, and when the range signal average strength is greater than the preset strength threshold within the peak division range data, the time point corresponding to the peak division range data is marked to generate initial point data;
[0043] The termination point of the peak division range data is confirmed by the initial point data. When the average intensity of the range signal is less than the intensity threshold within the preset peak division range data, the time point corresponding to the peak division range data is marked to generate the termination point data.
[0044] The present invention can accurately identify the peak value in the echo signal and improve the accuracy of signal processing by drawing a signal intensity variation curve and performing echo peak information analysis on it to generate echo peak information data. According to the preset peak cutting range, the echo peak information data is segmented into signal ranges to generate peak division range data. This process helps to separate the effective part and noise in the echo signal and ensure the purity of the data. The peak division range data is subjected to sliding window calculation to obtain the range signal average intensity. The sliding window calculation can smooth the signal, reduce the influence of random noise, and improve the reliability of the signal intensity data. The peak division range data is confirmed at the initial point by the range signal average intensity. When the range signal average intensity is greater than the preset intensity threshold, the corresponding time point is marked to generate the initial point data. This step can accurately locate the starting point of the echo signal and ensure the accuracy of the measurement. The peak division range data is confirmed at the end point by the initial point data. When the range signal average intensity is less than the preset intensity threshold, the corresponding time point is marked to generate the end point data. This step can accurately locate the end point of the echo signal and further improve the accuracy of the measurement.
[0045] Preferably, step S4 comprises the following steps:
[0046] Step S41: performing three-dimensional sonar imaging on the underwater target scanning echo electrical signal based on the signal processing module of the three-dimensional side scan sonar to generate a three-dimensional reconstructed image of the underwater target;
[0047] Step S42: constructing a three-dimensional scene of the target through the three-dimensional reconstructed image of the underwater target and the water depth information data to generate a three-dimensional scene of the underwater target;
[0048] Step S43: The underwater target three-dimensional scene is transmitted to the sonar platform for display, thereby generating a three-dimensional imaging picture of the underwater target.
[0049] The present invention processes the underwater target scanning echo electrical signal through the signal processing module of the three-dimensional side-scan sonar to generate a three-dimensional reconstructed image of the underwater target. The three-dimensional imaging technology can provide detailed shape and structural information of the target, significantly improving the accuracy and effect of detection. Combining the three-dimensional reconstructed image of the underwater target and the water depth information data, the three-dimensional scene of the target is constructed to generate a complete three-dimensional scene of the underwater target. This can more comprehensively display the positional relationship between the underwater environment and the target, which is helpful for further analysis and decision-making. The generated three-dimensional scene of the underwater target is transmitted to the sonar platform for display, thereby generating a three-dimensional imaging picture of the underwater target. This step can display complex three-dimensional data in an intuitive way, which is convenient for users to observe and analyze.
[0050] Preferably, step S41 includes the following steps:
[0051] Step S411: performing target azimuth estimation on the underwater target scanning echo electrical signal based on the signal processing module of the three-dimensional side scan sonar to obtain target azimuth estimation data; performing target echo amplitude estimation on the underwater target scanning echo electrical signal to obtain target echo amplitude estimation data;
[0052] Step S412: using a fast imaging formula to perform initial fast imaging on the target azimuth estimation data and the target echo amplitude estimation data to generate an initial image of the underwater target;
[0053] Step S413: performing image preprocessing on the underwater target initial image to generate a standard underwater target initial image, wherein the image preprocessing includes image denoising, image brightness enhancement and image smoothing;
[0054] Step S414: performing low point cloud density processing on the standard underwater target initial image to generate a low point cloud density image of the underwater target; performing three-dimensional image reconstruction on the underwater target low point cloud density image to generate a three-dimensional reconstructed image of the underwater target, wherein the three-dimensional image reconstruction includes single frame reconstruction, filtering, registration and stitching.
[0055] The present invention uses a signal processing module of a three-dimensional side-scan sonar to estimate the target azimuth and echo amplitude of an underwater target scanning echo electrical signal to obtain corresponding data. This step can accurately locate the target's azimuth and reflection intensity, and provide basic data for subsequent imaging. The target azimuth estimation data and the target echo amplitude estimation data are initially imaged quickly using a fast imaging formula to generate an underwater target initial image. Fast imaging can provide a preliminary target outline to help quickly understand the approximate shape and position of the target. The initial image is image preprocessed to generate a standard underwater target initial image. Image preprocessing includes denoising, brightness enhancement and smoothing, which can significantly improve the image quality, reduce noise and interference, and make the image clearer and easier to analyze. The standard initial image is processed with low point cloud density to generate a low point cloud density image. Then, the low point cloud density image is reconstructed into a three-dimensional image, including single-frame reconstruction, filtering, registration and splicing, to generate a three-dimensional reconstructed image of the underwater target. Low point cloud density processing can reduce the amount of data and improve calculation efficiency; three-dimensional reconstruction can generate a high-precision three-dimensional image to display the detailed structure of the target.
[0056] Preferably, the rapid imaging formula in step S412 is as follows:
[0057]
[0058] In the formula, Indicated as at position The imaging results at Represented as the target echo in frequency space The target reflection amplitude at Expressed as the frequency-space wavelength reflection characteristic coefficient, Expressed as the frequency-space wavelength scattering characteristic coefficient, Expressed as wave number, It is expressed as a phase correction term for the frequency-space wavelength reflection characteristic coefficient and the frequency-space wavelength scattering characteristic coefficient, Expressed as the horizontal coordinate of the underwater target in the space domain, Expressed as the ordinate of the underwater target in the space domain, Expressed as an imaginary unit.
[0059] The present invention analyzes and integrates a fast imaging formula based on the principle of Fourier transform, which converts the target's response in frequency space (through echo amplitude) into Table description) is converted into imaging results in the spatial domain The key steps in the formula include: Application of Fourier transform: Convert the frequency domain response of the target to Transform to the spatial domain. Phase correction: Phase term Considering the wave number , in frequency space and , and phase correction , these terms play a key role in the precision and accuracy of imaging, especially in complex environments, such as those with large noise or reflector diversity. Integration operation: In the frequency space The integral solution on is used to convert the frequency information of the target into pixel values in space. The wave number is related to the wavelength and directly affects the spatial resolution of the imaging. A higher wave number means a shorter wavelength, which helps to resolve subtle target details. Frequency space variables and Describes the position and distribution of the target in the frequency domain, affecting the spatial spectrum characteristics of imaging. By sampling and analyzing the target in the frequency space, the spatial position and shape of the target can be restored more accurately. Phase correction Considering the compensation of propagation path and fine-tuning of target position is crucial to the accuracy of imaging. Especially in long-distance propagation or complex environments, phase correction can significantly improve the imaging quality. When using the conventional fast imaging formula in the field, it can be obtained at position The imaging result at the position can be more accurately calculated by applying the fast imaging formula provided by the present invention. The imaging result at Selection and frequency space variables and The analysis can achieve high-resolution target imaging and capture the subtle structure and features of the target. Precise adjustment helps reduce the impact of environmental noise and interference, and improves the clarity and reliability of imaging. Adapting to changes in frequency response and target distribution makes the fast imaging formula perform well in dealing with complex scenes and diverse targets.
[0060] The beneficial effect of the present invention is that the position information of underwater targets is obtained by various sensors or technical means, which provides basic data of target position for subsequent sonar detection. By arranging a three-dimensional side-scan sonar in an underwater environment, a three-dimensional scan of underwater targets can be achieved to obtain spatial information of the target. By aligning the underwater target position information and the sonar deployment position information, the relationship between the target and the sonar can be accurately determined, providing accurate data for subsequent sonar detection and adjustment. By using multiple sound wave emission signals to form multiple beams, the side-scan range and resolution of the sonar can be increased, and the detection effect of underwater targets can be improved. Underwater target scanning echo signals are received, and these echo signals contain the reflection information of the target, which can be used for subsequent signal processing and imaging. The echo signals are converted into digital signals to facilitate subsequent signal processing and analysis. Understanding the underwater environment, such as water depth and other information, can help to analyze and process the scanning data more accurately. Determining the starting point and end point of the scanning range can help determine the position and shape of the underwater target. Through water depth calculation, the position information of the underwater target in the vertical direction can be obtained, providing accurate height data for subsequent imaging and scene construction. By processing and analyzing the scanning echo signal of the underwater target, a three-dimensional reconstructed image of the underwater target can be generated to display the shape and position information of the target. By combining the three-dimensional reconstructed image of the underwater target with the water depth information, a more realistic underwater target scene can be constructed to provide more comprehensive target information. Generating a three-dimensional imaging picture of the underwater target can help researchers or operators understand the characteristics and position of the underwater target more intuitively. Therefore, the present invention improves the accuracy of underwater target detection by performing multi-beam side scanning on the underwater target, using phased emission and rapid imaging of the underwater target. BRIEF DESCRIPTION OF THE DRAWINGS
[0061] Figure 1 A schematic diagram of the steps of a multi-view underwater target detection method for three-dimensional side scan sonar;
[0062] Figure 2 for Figure 1 Detailed implementation steps of step S2 in the flowchart;
[0063] Figure 3 for Figure 1 Detailed implementation steps of step S3 in FIG.
[0064] Figure 4 for Figure 1 Detailed implementation steps of step S4 in FIG.
[0065] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0066] The following is a clear and complete description of the technical method of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by technicians in this field without creative work are within the scope of protection of the present invention.
[0067] In addition, the accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. The functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor methods and / or microcontroller methods.
[0068] It should be understood that although the terms "first", "second", etc. may be used herein to describe various units, these units should not be limited by these terms. These terms are used only to distinguish one unit from another. For example, without departing from the scope of the exemplary embodiments, a first unit may be referred to as a second unit, and similarly, a second unit may be referred to as a first unit, and the term "and / or" used herein includes any and all combinations of one or more of the listed associated items.
[0069] To achieve this, please refer to Figures 1 to 4 , a multi-view underwater target detection method for three-dimensional side-scan sonar, the method comprising the following steps:
[0070] Step S1: Acquire underwater target position information data; perform three-dimensional side-scan sonar deployment according to the underwater target position information data, thereby obtaining three-dimensional side-scan sonar deployment position information data; perform coordinate space alignment on the underwater target position information data and the three-dimensional side-scan sonar deployment position information data, and generate target-sonar center point alignment data; perform detection azimuth adjustment on the three-dimensional side-scan sonar according to the target-sonar center point alignment data, thereby generating three-dimensional side-scan sonar detection adjustment data;
[0071] Step S2: performing a three-dimensional multi-beam side scan on the underwater target based on the three-dimensional side scan sonar detection adjustment data to generate a multi-beam acoustic wave transmission signal; receiving an echo signal according to the multi-beam acoustic wave transmission signal to obtain an underwater target scanning echo signal; performing digital signal conversion on the underwater target scanning echo signal to generate an underwater target scanning digital signal;
[0072] Step S3: Acquire underwater environment data; confirm the initial and end positions of the underwater target scanning digital signal to obtain the initial point data and the end point data, calculate the water depth of the initial point data and the end point data according to the underwater environment data, and obtain the water depth information data;
[0073] Step S4: Perform three-dimensional sonar imaging on the underwater target scanning echo electrical signal to generate a three-dimensional reconstructed image of the underwater target; construct a three-dimensional scene of the target through the three-dimensional reconstructed image of the underwater target and the water depth information data, thereby generating a three-dimensional imaging picture of the underwater target.
[0074] The present invention obtains the position information of the underwater target by using a positioning system or other sensors, which is usually recorded in the form of coordinates. According to the position information of the underwater target, the deployment position of the three-dimensional side-scan sonar is determined to ensure that the sonar can effectively cover the target area. The position information data of the underwater target and the deployment position information of the three-dimensional side-scan sonar are aligned in coordinate space to ensure the consistency of the two in the same coordinate system. According to the data after the coordinate space alignment, the alignment data of the target position and the sonar center point position are generated, and these data will be used for the subsequent sonar detection azimuth adjustment. The detection azimuth of the three-dimensional side-scan sonar is adjusted using the target-sonar center point alignment data to optimize the detection efficiency and accuracy of the sonar. According to the sonar detection azimuth adjustment data in step S1, the three-dimensional side-scan sonar is adjusted to prepare for the subsequent three-dimensional multi-beam side scan. Based on the adjusted sonar detection azimuth, a multi-beam acoustic wave signal is emitted to cover the target area and obtain echo information in more directions. The echo signals from the underwater target are received using a sonar receiver array, and these signals contain the characteristic information of the underwater target. The received echo signal is subjected to digital signal processing, including filtering, amplification and digital conversion, for subsequent analysis and processing. Sensors are used to obtain relevant data of the underwater environment, such as water temperature, water quality, water flow, etc., which will affect the speed and propagation path of sound waves in the water. Based on the echo signal intensity data, a signal intensity change curve is drawn, and its peak information is analyzed to confirm the initial and end points of the echo. According to the sound wave propagation time and underwater environmental data, the water depth information of the underwater target is calculated, which can provide a more accurate description of the target location. The received echo signal is imaged using a three-dimensional side-scan sonar to generate a three-dimensional reconstructed image of the underwater target. Combined with the three-dimensional reconstructed image of the underwater target and the previously calculated water depth information, a complete three-dimensional scene of the underwater target is constructed. The constructed three-dimensional scene is transmitted to a display device or sonar platform to generate a visualized three-dimensional imaging screen of the underwater target for analysis and display, which can effectively help the detection and imaging of underwater targets and improve the efficiency and accuracy of task execution. Therefore, the present invention improves the accuracy of underwater target detection by performing multi-beam side scanning on the underwater target, utilizing phased emission, and performing rapid imaging on the underwater target.
[0075] In the embodiment of the present invention, reference Figure 1 The above is a schematic flow chart of the steps of a multi-perspective underwater target detection method of a three-dimensional side-scan sonar of the present invention. In this example, the multi-perspective underwater target detection method of a three-dimensional side-scan sonar includes the following steps:
[0076] Step S1: Acquire underwater target position information data; perform three-dimensional side-scan sonar deployment according to the underwater target position information data, thereby obtaining three-dimensional side-scan sonar deployment position information data; perform coordinate space alignment on the underwater target position information data and the three-dimensional side-scan sonar deployment position information data, and generate target-sonar center point alignment data; perform detection azimuth adjustment on the three-dimensional side-scan sonar according to the target-sonar center point alignment data, thereby generating three-dimensional side-scan sonar detection adjustment data;
[0077] In an embodiment of the present invention, the position information of the underwater target is obtained by using GPS or other positioning systems, which can be obtained through buoys, underwater detectors or previous sonar scanning results. The three-dimensional side-scan sonar equipment is installed on a ship or a fixed platform. The deployment position and direction of the sonar are determined to ensure that the area where the underwater target is located can be effectively covered. The underwater target position information data and the sonar deployment position information data are aligned in coordinate space. The position and attitude relationship of the underwater target relative to the sonar equipment is determined for subsequent sonar detection and data processing. Based on the data after the coordinate space alignment, a target-sonar center point aligned data set is generated, which reflects the accurate position and direction relationship of the underwater target relative to the center point of the sonar equipment. According to the target-sonar center point aligned data, the detection azimuth and scanning parameters of the three-dimensional side-scan sonar are adjusted. Ensure that the sonar can effectively scan and detect underwater targets and maximize the detection accuracy and imaging quality of the target.
[0078] Step S2: performing a three-dimensional multi-beam side scan on the underwater target based on the three-dimensional side scan sonar detection adjustment data to generate a multi-beam acoustic wave transmission signal; receiving an echo signal according to the multi-beam acoustic wave transmission signal to obtain an underwater target scanning echo signal; performing digital signal conversion on the underwater target scanning echo signal to generate an underwater target scanning digital signal;
[0079] In an embodiment of the present invention, the emission parameters of the sonar device and the emission angle of the sound wave are adjusted according to the detection adjustment data obtained in step S1. Multi-beam technology is used, that is, multiple sound beams are emitted simultaneously to cover a wider underwater target area. After the sound wave is emitted, the sonar device receives the echo signal of the underwater target. The receiving device captures the intensity and time information of the underwater target echo according to the set receiving parameters. The received analog echo signal is converted into a digital signal. An analog-to-digital converter (ADC) with a high-speed sampling rate is used to convert the analog signal into a digital form. The acquired digital signal is preprocessed, including denoising, filtering and gain adjustment, to improve the quality and readability of the signal.
[0080] Step S3: Acquire underwater environment data; confirm the initial and end positions of the underwater target scanning digital signal to obtain the initial point data and the end point data, calculate the water depth of the initial point data and the end point data according to the underwater environment data, and obtain the water depth information data;
[0081] In an embodiment of the present invention, underwater environmental sensors such as sonar or underwater rangefinders are configured to obtain underwater environmental data. Environmental data include information such as water temperature, water density, and salinity, which have an impact on underwater acoustic propagation and water depth calculation. The underwater target scanning digital signal obtained in step S2 is analyzed. The initial point and the end point of each scanning signal, that is, the start and end position of the echo, are confirmed. The distance between the underwater target and the sonar device is calculated using the sonar reflection time and the propagation speed. The water depth information of each scanning signal is calculated according to the propagation speed of the sound wave (usually calculated based on environmental data such as water temperature and salinity). Based on the underwater environmental data, the propagation speed of the sound wave in the water is calculated, which involves applying a sound speed model such as the Chen-Millero formula or other empirical formulas according to factors such as water temperature, salinity and water depth. The calculated water depth information data is integrated with the scanning signal data in step S2. Ensure that the water depth information of each scanning signal corresponds to the corresponding underwater target position data.
[0082] Step S4: Perform three-dimensional sonar imaging on the underwater target scanning echo electrical signal to generate a three-dimensional reconstructed image of the underwater target; construct a three-dimensional scene of the target through the three-dimensional reconstructed image of the underwater target and the water depth information data, thereby generating a three-dimensional imaging picture of the underwater target.
[0083] In an embodiment of the present invention, the timestamp or unique index of each scanning signal is used to match the calculated water depth information data. Ensure that the scanning signal of each underwater target is aligned with the corresponding water depth data in time or index. Integrate the scanning signal data and the water depth information data into a structured data set. Each data record should include the location information (longitude, latitude, depth, etc.) of the underwater target, the scanning signal data (amplitude, time, direction, etc.) and the corresponding water depth information. For any unmatched or abnormal data points, error handling or data cleaning is performed to ensure the consistency and accuracy of the data. Data visualization tools or scripts can be used for anomaly detection and repair. The integrated data is stored in a database or saved as a file for subsequent analysis and application. Ensure the security and accessibility of data storage to facilitate team members or other systems to access and use data. Use sonar data processing software or custom scripts to further analyze and process the integrated data. Data mining, pattern recognition or statistical analysis can be performed to extract the characteristics and behavior information of underwater targets.
[0084] Preferably, step S1 comprises the following steps:
[0085] Step S11: Acquire underwater target position information data;
[0086] Step S12: deploying a three-dimensional side-scan sonar according to the underwater target position information data, thereby obtaining three-dimensional side-scan sonar deployment position information data;
[0087] Step S13: performing position center point identification on the underwater target position information data and the three-dimensional side scan sonar deployment position information data, thereby generating underwater target center point position data and three-dimensional side scan sonar center point position data;
[0088] Step S14: Align the underwater target center point position data and the three-dimensional side-scan sonar center point position data in coordinate space to generate target-sonar center point alignment data; adjust the detection azimuth of the three-dimensional side-scan sonar according to the target-sonar center point alignment data to generate three-dimensional side-scan sonar detection adjustment data.
[0089] In an embodiment of the present invention, the initial position information of the underwater target is obtained by using an underwater positioning device (such as an underwater positioning system, a sonar positioning system, etc.). The target position information data collected by the positioning device is recorded, including the longitude, latitude and depth data of the target. According to the acquired underwater target position information data, the optimal three-dimensional side scan sonar deployment position is analyzed and determined. The three-dimensional side scan sonar device is deployed at a predetermined position to ensure that the sonar can cover the target area. The deployment position information of the three-dimensional side scan sonar is recorded, including the longitude, latitude and depth data of the sonar. The underwater target position information data and the three-dimensional side scan sonar deployment position information data are input into the data processing system. The center point position of the target and the sonar is calculated using an algorithm to obtain the underwater target center point position data and the three-dimensional side scan sonar center point position data, and the calculated center point position information is output and recorded. The underwater target center point position data and the three-dimensional side scan sonar center point position data are aligned in coordinate space to generate target-sonar center point alignment data. Adjust the detection azimuth of the 3D side scan sonar according to the alignment data to ensure that the sonar can cover the target area at the best angle, record the adjusted 3D side scan sonar detection adjustment data, and use AUV (autonomous underwater vehicle) or ROV (remotely controlled underwater vehicle) to conduct a preliminary scan of the target area to determine the approximate location of the target. For example, the location information data of an underwater target is: longitude 120.0000, latitude 35.0000, depth 50 meters. According to the target location information, choose to deploy the 3D side scan sonar equipment 500 meters northwest of the target to ensure that the coverage of the sonar includes the target area. The deployment location information data is: longitude 119.9950, latitude 35.0050, depth 45 meters. Enter the target location information and sonar deployment location information to calculate the center point position of the target and sonar. The calculated center point position data are: target center point (120.0000, 35.0000, 50 meters), sonar center point (119.9950, 35.0050, 45 meters). Perform spatial alignment between the target center point and the sonar center point, and adjust the sonar detection azimuth. The generated alignment data is: target-sonar center point alignment data (after alignment, the sonar detection azimuth angle is 30 degrees).
[0090] As an example of the present invention, refer to Figure 2 As shown, in this example, step S2 includes:
[0091] Step S21: performing a three-dimensional multi-beam side scan on the underwater target through a driving transducer in the three-dimensional side scan sonar based on the three-dimensional side scan sonar detection adjustment data to generate a multi-beam acoustic wave transmission signal;
[0092] Step S22: using the receiving transducer array in the three-dimensional side-scan sonar to receive the echo signal according to the multi-beam acoustic wave transmission signal, to obtain the underwater target scanning echo signal;
[0093] Step S23: converting the underwater target scanning echo signal into an electrical signal to generate an underwater target scanning echo electrical signal;
[0094] Step S24: converting the underwater target scanning echo electrical signal into a digital signal to generate an underwater target scanning digital signal.
[0095] In an embodiment of the present invention, the detection angle and parameters of the sonar are adjusted by using the three-dimensional side-scan sonar detection adjustment data generated in step S1 to ensure coverage of the target area. Multi-beam acoustic wave transmission signals are emitted by the driving transducer in the three-dimensional side-scan sonar, and these signals are emitted at different angles and directions to cover a wide underwater area. The parameters of the emitted multi-beam acoustic wave signals are recorded, including information such as the emission angle, frequency, and intensity, wherein the three-dimensional side-scan sonar includes a plurality of transmitting transducers, which emit sound pulse signals of different beams in different directions. The transmitting transducer transmits sound pulse signals in sequence or at different times according to the preset three-dimensional scanning rules to achieve three-dimensional lateral coverage scanning of underwater targets. The emission time and emission angle corresponding to each transmitting transducer are recorded to generate a multi-beam sound emission signal parameter table. The receiving transducer array in the three-dimensional side-scan sonar is used to receive the echo signal from the underwater target. According to the multi-beam acoustic wave signal emitted in step S21, the multi-beam echo signal of the underwater target is received, and the received underwater target scanning echo signal is recorded, including the echo intensity, time delay and frequency characteristics of each beam. The three-dimensional side-scan sonar is equipped with an array composed of multiple receiving transducers, which can simultaneously receive multi-channel echo signals. According to the parameter table of the multi-beam transmission signal, the receiving array identifies the echo signals corresponding to different directions and times. The echo signals from different transmission beam directions are received sequentially or simultaneously within a certain time window. The received echo signal is pre-processed by electrical signal conversion, and the signal gain of the underwater target scanning echo signal is optimized to enhance the signal quality and reduce noise interference. Each received echo signal is amplified, filtered, and analog-to-digital converted. The time series and receiving parameters of each echo signal are uniformly organized into a data table in a standard digital format.
[0096] Preferably, step S21 includes the following steps:
[0097] Step S241: updating the underwater target position information data in time series based on the three-dimensional side scan sonar detection adjustment data to obtain the target point time series position update data;
[0098] Step S242: constructing a target point moving trajectory according to the target point time-series position update data to generate a target point movement route; adjusting the transmission beam angle of the three-dimensional side-scan sonar according to the target point movement route to generate three-dimensional side-scan sonar transmission angle adjustment data;
[0099] Step S243: performing distance analysis on the three-dimensional side scan sonar emission angle adjustment data and the target point movement route to generate sonar-target distance data; performing emission array element phase superposition on the three-dimensional side scan sonar through the sonar-target distance data to generate emission array element phase superposition data;
[0100] Step S244: performing multi-angle three-dimensional multi-beam scanning on the three-dimensional side-scan sonar by transmitting array element phase superposition data, thereby generating a multi-beam acoustic wave transmission signal.
[0101] In an embodiment of the present invention, the position information data of the underwater target is updated by using the three-dimensional side scan sonar detection adjustment data generated in step S1. According to the detection range of the sonar and the movement of the underwater target, the time series position information of the target is updated, and the position coordinates of the target at each moment are recorded. According to the target point time series position update data, the motion trajectory of the underwater target is constructed. Using the time series position data, the moving direction and speed of the target in different time periods are calculated to generate motion route information. Based on the target point motion route and the position data of the three-dimensional side scan sonar, the distance relationship between the sonar and the target is analyzed. By calculating the distance between the target and the sonar at different positions, the sonar-target distance data is generated for subsequent angle adjustment and sonar imaging. According to the transmitting array element phase superposition data, the transmitting angle and beam direction of the three-dimensional side scan sonar are adjusted. Using the pre-calculated transmitting array element phase superposition data, the transmitting beam of the sonar is adjusted so that it transmits multi-beam acoustic wave signals at different angles. More specifically, the target position data is updated every 1 second, and the changes of the X, Y, and Z coordinates of the target over time are recorded. A mathematical model or an interpolation algorithm is used to generate a smooth motion trajectory according to the updated target position data. Based on the distance calculation result between the sonar and the target, the sonar emission angle adjustment data is generated and used for subsequent sonar signal processing. Based on the preset multi-beam emission angle and sonar position, multi-angle sound wave signals are emitted for subsequent underwater target imaging and positioning.
[0102] Preferably, step S23 includes the following steps:
[0103] Step S231: optimizing the signal gain of the underwater target scanning echo signal to generate an underwater target scanning echo amplified signal;
[0104] Step S232: performing signal bandpass filtering on the underwater target scanning echo amplified signal to generate an underwater target scanning echo filtered sonar signal;
[0105] Step S233: performing high-precision analog-to-digital conversion on the underwater target scanning echo filtering sonar signal through an analog-to-digital converter to generate an underwater target scanning digitized sonar signal; performing time domain correction on the underwater target scanning digitized sonar signal to generate an underwater target scanning correction sonar signal;
[0106] Step S234: performing real-time data packaging on the underwater target scanning correction sonar signal to generate an underwater target scanning echo electrical signal.
[0107] In an embodiment of the present invention, the signal gain optimization is performed on the received underwater target scanning echo signal to enhance the signal strength and clarity. According to the preset gain parameters, the amplification factor of the receiving device is adjusted to make the echo signal reach an appropriate amplitude. The echo signal after gain optimization is bandpass filtered to remove unnecessary frequency components and retain the frequency range of interest. The filter parameters, such as the center frequency and bandwidth, are set to filter the echo signal to remove noise and interference signals. The filtered analog echo signal is converted into a digitized sonar signal for subsequent digital signal processing and analysis. A high-precision analog-to-digital converter (ADC) is used to convert the filtered analog signal into a digital signal to ensure that the signal sampling rate and bit depth meet the requirements. The digitized sonar signal is corrected in the time domain to adjust the time delay and phase of the signal to make it more consistent with the actual situation. According to the calibration parameters of the sonar system, the digitized signal is corrected for time delay and phase to eliminate system errors. The sonar signal that has undergone gain optimization, filtering, analog-to-digital conversion and time domain correction is packaged in real time data for easy transmission and storage. The processed digitized sonar signal is packaged according to the preset data format, and a timestamp and other necessary metadata information are added to generate a complete underwater target scanning echo electrical signal.
[0108] As an example of the present invention, refer to Figure 3 As shown, in this example, step S3 includes:
[0109] Step S31: using sensors to obtain underwater environment data;
[0110] Step S32: performing echo signal strength analysis on the underwater target scanning digital signal to generate echo signal strength data;
[0111] Step S33: confirming the initial point data and the end point data of the echo through the echo signal strength data, and calculating the sound wave propagation time of the initial point data and the end point data according to the underwater environment data to obtain the sound wave propagation time data;
[0112] Step S34: Calculate the water depth using the echo signal strength data and the sound wave propagation time data to obtain water depth information data.
[0113] In the embodiment of the present invention, by measuring the underwater environmental parameters as needed, a suitable sensor such as a water temperature sensor, a water pressure sensor, a water quality sensor, etc. is selected. By using an underwater multi-parameter sensor, environmental parameters such as water temperature, water pressure, and salinity can be measured simultaneously. The data acquisition frequency of the sensor is set to ensure that sufficient data is obtained for subsequent analysis and processing. Underwater environmental data is collected once per second to ensure the real-time and accuracy of the data. The underwater target scanning digital signal obtained by processing in step S2 is used as the input for analysis. The processed digitized sonar signal is used as the basic data for echo signal intensity analysis. The intensity of the echo signal is analyzed using a mathematical algorithm or a signal processing technique to extract the intensity information of each echo. An algorithm such as FFT (Fast Fourier Transform) is applied to convert from the time domain to the frequency domain, and the peak intensity in the spectrum is analyzed. The echo signal intensity data obtained in step S32 is used to confirm the initial point and the end point of each echo. The start and end positions of the echo are detected by setting a threshold value for the signal intensity. The time difference from the emission of the sound wave to the arrival of the echo, i.e., the sound wave propagation time, is calculated based on the sound speed and propagation path of the underwater environment. The sound wave propagation time of each echo is calculated using the sound speed and the measured propagation distance. The sound wave propagation time data is converted into the distance between the underwater target and the sonar. The actual distance of the underwater target from the sonar is calculated based on the sound speed and propagation time. The water depth information data of the underwater target position is generated to indicate the depth of the underwater target or the horizontal distance from the sonar. The calculated water depth data is stored or output to the system for subsequent data processing and display.
[0114] Preferably, confirming the initial point and the end point of the echo by the echo signal strength data comprises:
[0115] Draw a signal strength change curve based on the echo signal strength data; perform echo peak information analysis on the signal strength change curve to generate echo peak information data;
[0116] According to the preset peak cutting range, the signal strength change curve is segmented into signal ranges according to the echo peak information data to generate peak division range data; the peak division range data is subjected to sliding window calculation to obtain the range signal average strength; the peak division range data is initial point confirmed by the range signal average strength, and when the range signal average strength is greater than the preset strength threshold within the peak division range data, the time point corresponding to the peak division range data is marked to generate initial point data;
[0117] The termination point of the peak division range data is confirmed by the initial point data. When the average intensity of the range signal is less than the intensity threshold within the preset peak division range data, the time point corresponding to the peak division range data is marked to generate the termination point data.
[0118] In an embodiment of the present invention, the received echo signal strength data is plotted into a variation curve, usually with time or sampling points as the horizontal coordinate and signal strength as the vertical coordinate. The drawn signal strength curve is analyzed to find the peak point, i.e., the point with the highest signal strength, which usually indicates the start and end of the echo. According to the peak point data, the time range of each echo is determined, i.e., the time period of the initial point and the end point. Within the time range of each echo, the average signal strength is calculated by a sliding window to further confirm the initial point and the end point. A more specific method for confirming the initial point is to use a sliding window to calculate the average strength of the signal at each time point. When the average strength exceeds a threshold value for the first time, the time point is recorded as the initial point, and the method for confirming the end point is to use a threshold fallback method, i.e., starting from the initial point, continue to monitor the signal strength. When the strength falls below the threshold value again, the time point is recorded as the end point.
[0119] As an example of the present invention, refer to Figure 4 As shown, in this example, step S4 includes:
[0120] Step S41: performing three-dimensional sonar imaging on the underwater target scanning echo electrical signal based on the signal processing module of the three-dimensional side scan sonar to generate a three-dimensional reconstructed image of the underwater target;
[0121] Step S42: constructing a three-dimensional scene of the target through the three-dimensional reconstructed image of the underwater target and the water depth information data to generate a three-dimensional scene of the underwater target;
[0122] Step S43: The underwater target three-dimensional scene is transmitted to the sonar platform for display, thereby generating a three-dimensional imaging picture of the underwater target.
[0123] In an embodiment of the present invention, a three-dimensional side-scan sonar is used to scan underwater targets and collect echo signal data. The echo signal is filtered to remove noise, and the gain and timing calibration of the signal are adjusted to ensure data quality. Phased array technology is used to control multiple transmitting and receiving beams to cover the underwater target area. The angles and directions of the transmitting and receiving beams are adjusted according to the position and shape of the underwater target to maximize the resolution and imaging quality of the target. The collected multi-beam echo data are superimposed and processed, and three-dimensional imaging is performed using sonar data processing software (such as CARIS HIPS and SIPS). Appropriate algorithms, such as time-frequency analysis, multi-view reconstruction, etc., are applied to convert the echo data into a three-dimensional point cloud or voxel grid to represent the shape and position of the underwater target. The three-dimensional point cloud or voxel grid data obtained in step S41 is combined with the water depth information (obtained from sonar measurement). The accurate position and shape of the underwater target are located and reconstructed in three-dimensional space. Use geographic information system (GIS) or professional 3D modeling software (such as Autodesk Maya, Blender) to convert the point cloud or voxel grid data of the underwater target into a specific 3D scene model. Consider the size, shape and surrounding environment of the underwater target, and perform detailed scene modeling and texture mapping. Transmit the constructed 3D scene data of the underwater target to the sonar platform or related display devices. Display and render the 3D imaging screen of the underwater target in real time on the sonar platform. Use the visualization tools and rendering engine provided by the platform to display the details and environmental background of the underwater target.
[0124] Preferably, step S41 includes the following steps:
[0125] Step S411: performing target azimuth estimation on the underwater target scanning echo electrical signal based on the signal processing module of the three-dimensional side scan sonar to obtain target azimuth estimation data; performing target echo amplitude estimation on the underwater target scanning echo electrical signal to obtain target echo amplitude estimation data;
[0126] Step S412: using a fast imaging formula to perform initial fast imaging on the target azimuth estimation data and the target echo amplitude estimation data to generate an initial image of the underwater target;
[0127] Step S413: performing image preprocessing on the underwater target initial image to generate a standard underwater target initial image, wherein the image preprocessing includes image denoising, image brightness enhancement and image smoothing;
[0128] Step S414: performing low point cloud density processing on the standard underwater target initial image to generate a low point cloud density image of the underwater target; performing three-dimensional image reconstruction on the underwater target low point cloud density image to generate a three-dimensional reconstructed image of the underwater target, wherein the three-dimensional image reconstruction includes single frame reconstruction, filtering, registration and stitching.
[0129] In an embodiment of the present invention, the echo signal data of the underwater target is obtained by using a three-dimensional side-scan sonar device. The echo signal is subjected to time-frequency analysis or multi-beam processing to obtain the azimuth information of the underwater target. The angle or position estimation of the target in the horizontal and vertical directions is calculated to obtain the target azimuth estimation data. The amplitude and intensity of the echo signal are analyzed to extract the amplitude information of the target echo. According to the sensitivity and setting of the sonar system, the intensity of the target echo is measured to obtain the target echo amplitude estimation data. A fast imaging formula, such as the fast imaging algorithm of RADAR or SONAR, is used to combine the target azimuth estimation and the echo amplitude estimation data. According to the target position and the echo intensity, a preliminary underwater target imaging image is quickly generated. The initial imaging image is denoised, and an appropriate filtering algorithm (such as median filtering, Gaussian filtering) is used to remove random noise and clutter in the echo. The brightness and contrast of the image are adjusted to enhance the visibility of the underwater target in the image. Histogram equalization or contrast enhancement technology is used to enhance the visual effect of the image. Apply smoothing filters (such as mean filters, bilateral filters) to reduce noise and details in the image, making the image clearer and more continuous. Convert the preprocessed image data into low point cloud density data. During the processing, adjust the resolution and density of the point cloud according to the image quality and requirements for subsequent 3D reconstruction. Perform a separate 3D reconstruction for each frame of the image, converting the pixels in the image into point clouds or voxels in space. Apply filtering algorithms to the reconstructed point cloud or voxel data to remove residual noise and unnecessary points. Perform point cloud registration to ensure data alignment and consistency between frames. Stitch the processed point cloud or voxel data to generate a complete 3D reconstructed image of the underwater target. Combine the azimuth and amplitude data obtained in the previous steps to ensure the correct position and representation of each point in the 3D scene.
[0130] Preferably, the rapid imaging formula in step S412 is as follows:
[0131]
[0132] In the formula, Indicated as at position The imaging results at Represented as the target echo in frequency space The target reflection amplitude at Expressed as the frequency-space wavelength reflection characteristic coefficient, Expressed as the frequency-space wavelength scattering characteristic coefficient, Expressed as wave number, It is expressed as a phase correction term for the frequency-space wavelength reflection characteristic coefficient and the frequency-space wavelength scattering characteristic coefficient, Expressed as the horizontal coordinate of the underwater target in the space domain, Expressed as the ordinate of the underwater target in the space domain, Expressed as an imaginary unit.
[0133] The present invention analyzes and integrates a fast imaging formula based on the principle of Fourier transform, which converts the target's response in frequency space (through echo amplitude) into Table description) is converted into imaging results in the spatial domain The key steps in the formula include: Application of Fourier transform: Convert the frequency domain response of the target to Transform to the spatial domain. Phase correction: Phase term Considering the wave number , in frequency space and , and phase correction , these terms play a key role in the precision and accuracy of imaging, especially in complex environments, such as those with large noise or reflector diversity. Integration operation: In the frequency space The integral solution on is used to convert the frequency information of the target into pixel values in space. The wave number is related to the wavelength and directly affects the spatial resolution of the imaging. A higher wave number means a shorter wavelength, which helps to resolve subtle target details. Frequency space variables and Describes the position and distribution of the target in the frequency domain, affecting the spatial spectrum characteristics of imaging. By sampling and analyzing the target in the frequency space, the spatial position and shape of the target can be restored more accurately. Phase correction Considering the compensation of propagation path and fine-tuning of target position is crucial to the accuracy of imaging. Especially in long-distance propagation or complex environments, phase correction can significantly improve the imaging quality. When using the conventional fast imaging formula in the field, it can be obtained at position The imaging result at the position can be more accurately calculated by applying the fast imaging formula provided by the present invention. The imaging result at Selection and frequency space variables and The analysis can achieve high-resolution target imaging and capture the subtle structure and features of the target. Precise adjustment helps reduce the impact of environmental noise and interference, and improves the clarity and reliability of imaging. Adapting to changes in frequency response and target distribution makes the fast imaging formula perform well in dealing with complex scenes and diverse targets.
[0134] The beneficial effect of the present invention is that the position information of underwater targets is obtained by various sensors or technical means, which provides basic data of target position for subsequent sonar detection. By arranging a three-dimensional side-scan sonar in an underwater environment, a three-dimensional scan of underwater targets can be achieved to obtain spatial information of the target. By aligning the underwater target position information and the sonar deployment position information, the relationship between the target and the sonar can be accurately determined, providing accurate data for subsequent sonar detection and adjustment. By using multiple sound wave emission signals to form multiple beams, the side-scan range and resolution of the sonar can be increased, and the detection effect of underwater targets can be improved. Underwater target scanning echo signals are received, and these echo signals contain the reflection information of the target, which can be used for subsequent signal processing and imaging. The echo signals are converted into digital signals to facilitate subsequent signal processing and analysis. Understanding the underwater environment, such as water depth and other information, can help to analyze and process the scanning data more accurately. Determining the starting point and end point of the scanning range can help determine the position and shape of the underwater target. Through water depth calculation, the position information of the underwater target in the vertical direction can be obtained, providing accurate height data for subsequent imaging and scene construction. By processing and analyzing the scanning echo signal of the underwater target, a three-dimensional reconstructed image of the underwater target can be generated to display the shape and position information of the target. By combining the three-dimensional reconstructed image of the underwater target with the water depth information, a more realistic underwater target scene can be constructed to provide more comprehensive target information. Generating a three-dimensional imaging picture of the underwater target can help researchers or operators understand the characteristics and position of the underwater target more intuitively. Therefore, the present invention improves the accuracy of underwater target detection by performing multi-beam side scanning on the underwater target, using phased emission and rapid imaging of the underwater target.
[0135] Therefore, the embodiments should be regarded as illustrative and non-restrictive from all points, and the scope of the present invention is limited by the appended claims rather than the above description, and it is therefore intended that all changes falling within the meaning and range of equivalent elements of the application documents are included in the present invention.
[0136] The above description is only a specific embodiment of the present invention, so that those skilled in the art can understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but should conform to the widest scope consistent with the principles and novel features invented herein.
Claims
1. A multi-view underwater target detection method for three-dimensional side-scan sonar, characterized in that: The following steps are involved: Step S1: Acquire underwater target location information data; Performing three-dimensional side-scan sonar deployment according to underwater target position information data, thereby obtaining three-dimensional side-scan sonar deployment position information data; Align the underwater target location information data and the 3D side-scan sonar deployment location information data in coordinate space to generate target-sonar center point alignment data; The detection azimuth of the three-dimensional side-scan sonar is adjusted according to the target-sonar center point alignment data, thereby generating three-dimensional side-scan sonar detection adjustment data; Step S2: performing a three-dimensional multi-beam side scan on the underwater target based on the three-dimensional side scan sonar detection adjustment data to generate a multi-beam acoustic wave transmission signal; receiving an echo signal according to the multi-beam acoustic wave transmission signal to obtain an underwater target scanning echo signal; performing digital signal conversion on the underwater target scanning echo signal to generate an underwater target scanning digital signal; Step S3: Acquire underwater environment data; confirm the initial and end positions of the underwater target scanning digital signal to obtain the initial point data and the end point data, calculate the water depth of the initial point data and the end point data according to the underwater environment data, and obtain the water depth information data; Step S4: performing three-dimensional sonar imaging on the underwater target scanning echo electrical signal to generate a three-dimensional reconstructed image of the underwater target; The three-dimensional scene of the target is constructed through the three-dimensional reconstructed image of the underwater target and the water depth information data, thereby generating a three-dimensional imaging picture of the underwater target.
2. The multi-view underwater target detection method of three-dimensional side-scan sonar according to claim 1, characterized in that: Step S1 includes the following steps: Step S11: Acquire underwater target position information data; Step S12: deploying a three-dimensional side-scan sonar according to the underwater target position information data, thereby obtaining three-dimensional side-scan sonar deployment position information data; Step S13: performing position center point identification on the underwater target position information data and the three-dimensional side scan sonar deployment position information data, thereby generating underwater target center point position data and three-dimensional side scan sonar center point position data; Step S14: Align the underwater target center point position data and the three-dimensional side-scan sonar center point position data in coordinate space to generate target-sonar center point alignment data; adjust the detection azimuth of the three-dimensional side-scan sonar according to the target-sonar center point alignment data to generate three-dimensional side-scan sonar detection adjustment data.
3. The multi-view underwater target detection method of three-dimensional side-scan sonar according to claim 1, characterized in that: Step S2 includes the following steps: Step S21: performing a three-dimensional multi-beam side scan on the underwater target through a driving transducer in the three-dimensional side scan sonar based on the three-dimensional side scan sonar detection adjustment data to generate a multi-beam acoustic wave transmission signal; Step S22: using the receiving transducer array in the three-dimensional side-scan sonar to receive the echo signal according to the multi-beam acoustic wave transmission signal, to obtain the underwater target scanning echo signal; Step S23: converting the underwater target scanning echo signal into an electrical signal to generate an underwater target scanning echo electrical signal; Step S24: converting the underwater target scanning echo electrical signal into a digital signal to generate an underwater target scanning digital signal.
4. The multi-view underwater target detection method of three-dimensional side-scan sonar according to claim 3, characterized in that: Step S21 includes the following steps: Step S241: updating the underwater target position information data in time series based on the three-dimensional side scan sonar detection adjustment data to obtain the target point time series position update data; Step S242: constructing a target point moving trajectory according to the target point time-series position update data to generate a target point movement route; adjusting the transmission beam angle of the three-dimensional side-scan sonar according to the target point movement route to generate three-dimensional side-scan sonar transmission angle adjustment data; Step S243: performing distance analysis on the three-dimensional side scan sonar emission angle adjustment data and the target point movement route to generate sonar-target distance data; performing emission array element phase superposition on the three-dimensional side scan sonar through the sonar-target distance data to generate emission array element phase superposition data; Step S244: performing multi-angle three-dimensional multi-beam scanning on the three-dimensional side-scan sonar by transmitting array element phase superposition data, thereby generating a multi-beam acoustic wave transmission signal.
5. The multi-view underwater target detection method of three-dimensional side-scan sonar according to claim 3, characterized in that: Step S23 includes the following steps: Step S231: optimizing the signal gain of the underwater target scanning echo signal to generate an underwater target scanning echo amplified signal; Step S232: performing signal bandpass filtering on the underwater target scanning echo amplified signal to generate an underwater target scanning echo filtered sonar signal; Step S233: performing high-precision analog-to-digital conversion on the underwater target scanning echo filtering sonar signal through an analog-to-digital converter to generate an underwater target scanning digitized sonar signal; performing time domain correction on the underwater target scanning digitized sonar signal to generate an underwater target scanning correction sonar signal; Step S234: performing real-time data packaging on the underwater target scanning correction sonar signal to generate an underwater target scanning echo electrical signal.
6. The multi-view underwater target detection method of three-dimensional side-scan sonar according to claim 1, characterized in that: Step S3 includes the following steps: Step S31: using sensors to obtain underwater environment data; Step S32: performing echo signal strength analysis on the underwater target scanning digital signal to generate echo signal strength data; Step S33: confirming the initial point data and the end point data of the echo through the echo signal strength data, and calculating the sound wave propagation time of the initial point data and the end point data according to the underwater environment data to obtain the sound wave propagation time data; Step S34: Calculate the water depth using the echo signal strength data and the sound wave propagation time data to obtain water depth information data.
7. The multi-view underwater target detection method of three-dimensional side-scan sonar according to claim 6, characterized in that: The echo signal strength data is used to confirm the start and end points of the echo, including: Draw a signal strength change curve based on the echo signal strength data; perform echo peak information analysis on the signal strength change curve to generate echo peak information data; According to the preset peak cutting range, the signal strength change curve is segmented into signal ranges according to the echo peak information data to generate peak division range data; the peak division range data is subjected to sliding window calculation to obtain the range signal average strength; the peak division range data is initial point confirmed by the range signal average strength, and when the range signal average strength is greater than the preset strength threshold within the peak division range data, the time point corresponding to the peak division range data is marked to generate initial point data; The termination point of the peak division range data is confirmed by the initial point data. When the average intensity of the range signal is less than the intensity threshold within the preset peak division range data, the time point corresponding to the peak division range data is marked to generate the termination point data.
8. The multi-view underwater target detection method of three-dimensional side-scan sonar according to claim 1, characterized in that: Step S4 includes the following steps: Step S41: performing three-dimensional sonar imaging on the underwater target scanning echo electrical signal based on the signal processing module of the three-dimensional side scan sonar to generate a three-dimensional reconstructed image of the underwater target; Step S42: constructing a three-dimensional scene of the target through the three-dimensional reconstructed image of the underwater target and the water depth information data to generate a three-dimensional scene of the underwater target; Step S43: The underwater target three-dimensional scene is transmitted to the sonar platform for display, thereby generating a three-dimensional imaging picture of the underwater target.
9. The multi-view underwater target detection method of three-dimensional side-scan sonar according to claim 8, characterized in that: Step S41 includes the following steps: Step S411: performing target azimuth estimation on the underwater target scanning echo electrical signal based on the signal processing module of the three-dimensional side scan sonar to obtain target azimuth estimation data; performing target echo amplitude estimation on the underwater target scanning echo electrical signal to obtain target echo amplitude estimation data; Step S412: using a fast imaging formula to perform initial fast imaging on the target azimuth estimation data and the target echo amplitude estimation data to generate an initial image of the underwater target; Step S413: performing image preprocessing on the underwater target initial image to generate a standard underwater target initial image, wherein the image preprocessing includes image denoising, image brightness enhancement and image smoothing; Step S414: performing low point cloud density processing on the standard underwater target initial image to generate a low point cloud density image of the underwater target; performing three-dimensional image reconstruction on the underwater target low point cloud density image to generate a three-dimensional reconstructed image of the underwater target, wherein the three-dimensional image reconstruction includes single frame reconstruction, filtering, registration and stitching.
10. The multi-view underwater target detection method of three-dimensional side-scan sonar according to claim 9, characterized in that: The rapid imaging formula in step S412 is as follows: In the formula, Indicated as at position The imaging results at Represented as the target echo in frequency space The target reflection amplitude at Expressed as the frequency-space wavelength reflection characteristic coefficient, Expressed as the frequency-space wavelength scattering characteristic coefficient, Expressed as wave number, It is expressed as a phase correction term for the frequency-space wavelength reflection characteristic coefficient and the frequency-space wavelength scattering characteristic coefficient, Expressed as the horizontal coordinate of the underwater target in the space domain, Expressed as the ordinate of the underwater target in the space domain, Expressed as an imaginary unit.
