Spatial alignment device and image fusion method for multi-image sonar system

Through the spatial alignment device and image fusion method of multi-image sonar system, the problems of low imaging quality and excessive image information in underwater target detection are solved, and high-precision underwater target recognition and high fidelity are achieved. Image representation reduces the burden on users and provides high-quality automated target recognition support.

CN115147696BActive Publication Date: 2024-11-26NO 719 RES INST CHINA SHIPBUILDING IND
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202210922696.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-02
Publication Date
2024-11-26
Estimated Expiration
2042-08-02

AI Technical Summary

Technical Problem

In the detection of underwater targets, existing sonar systems have problems such as low imaging quality, severe shading phenomenon and decreased sonar image feature information as the distance increases, which is difficult to meet the needs of high-precision underwater target recognition and scene construction, and there are many Too much sonar image information leads to visual fatigue and errors in judgment of the user.

Method used

The spatial alignment device of the multi-image sonar system is adopted, and the transformation matrix parameters of multiple sonar coordinate systems to the sonar system coordinate system are solved through high-precision multi-degree of freedom slide rail motion platform and acoustic identification, so as to solve the transformation matrix parameters of multiple sonar coordinate systems to the sonar system coordinate systems, and to perform image alignment and fusion, using Bilinear interpolation and fully variable regularization models convert multiple sonar images to the same coordinate space to achieve a unified view representation of high fidelity.

Benefits of technology

It improves the accuracy of spatial alignment data, reduces the burden on users, and provides high-quality data support for automated target recognition and tracking, achieving high-precision underwater target detection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115147696B_ABST
    Figure CN115147696B_ABST
Patent Text Reader

Abstract

The invention discloses a spatial alignment device and an image fusion method for a multi-image sonar system. The spatial alignment device mainly comprises: a multi-image sonar system installation platform, an acoustic marker installation platform, a high-precision multi-degree-of-freedom slide rail motion platform, a data acquisition system and a spatial alignment solution system; the high-precision multi-degree-of-freedom slide rail motion platform and the acoustic marker installation platform can be movably arranged on the high-precision multi-degree-of-freedom slide rail motion platform; the data acquisition system and the spatial alignment solution system are both connected with the high-precision multi-degree-of-freedom slide rail motion platform, the acoustic marker installation platform and the high-precision multi-degree-of-freedom slide rail motion platform data; wherein the relative position between the acoustic marker installation platform and the multi-image sonar system installation platform is adjusted, so that relative position data, acoustic marker detection data and multi-image sonar data can be accurately obtained.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of underwater target detection, and in particular to a spatial alignment device and an image fusion method for a multi-image sonar system which can be used for the alignment and unified spatial representation of multiple sonar data and improve the precision of sonar underwater target detection. Background Art

[0002] There is a huge difference between the underwater environment and the land environment. When the target is far away or the ambient light is dim, the quality of light imaging will be seriously degraded due to many factors such as the absorption and scattering of light by the water. Therefore, the use of sonar is currently the most effective means of detecting underwater targets at medium and long distances.

[0003] Sonar is mainly divided into passive sonar and active sonar. Active sonar is generally used for imaging in target search or environmental detection tasks. The advantage of this type of imaging sonar is that it is not affected by the optical environment and can quickly and accurately locate the target; the disadvantage is that the sonar imaging quality is lower than that of optical imaging, and it is affected by the target material, structure, and environmental scattering, and the edge features of the object are weakened, which brings inconvenience to the subsequent processing of the sonar image.

[0004] There are two main types of imaging sonars: one is side-scan sonar and the other is forward-looking sonar. Among them, side-scan sonar requires continuous image stitching through the navigation of the vehicle (similar to satellite scanning), which may be difficult to achieve online composition on the UUV. It is generally connected to the mother ship through a data cable for processing, or downloaded for offline processing. Forward-looking sonar can be divided into mechanical scanning sonar, multi-beam sonar, etc. according to the working mode. Mechanical scanning sonar obtains images of a certain area by scanning a single beam. It has a long imaging cycle and good imaging quality. There will be serious smearing when moving (suitable for fixed detection, ROV, etc.); multi-beam sonar forms multiple beams through beamforming technology, with fast imaging, poor imaging quality, and light smearing (suitable for UUV, divers, etc.).

[0005] Both side-scan sonar and forward-looking sonar have the disadvantage of limited sonar scanning angle resolution, which causes the sonar image feature information to decrease with increasing distance. This feature loss poses a great challenge to underwater target recognition and high-precision scene construction. Therefore, sonar image enhancement is an important task in sonar system data preprocessing. With the growth of underwater security, rescue and salvage needs, higher and higher requirements are put forward for sonar detection. It is necessary to obtain the characteristics of underwater targets / environments more comprehensively and finely. The detection system of a single sonar, even with image enhancement, is difficult to adapt to development needs. Therefore, a solution for joint detection of multiple sonars was born, and the precision of detection was improved through sonar data redundancy. To this end, multi-image sonar systems integrating multiple sonars have gradually received attention and are increasingly applied to the field of target detection.

[0006] The multi-image sonar system is generally composed of several image sonars with non-overlapping working frequency bands, which can provide users with sonar detection images in multiple frequency bands and viewing angles, and can achieve large-scale, high-precision detection. However, the images of multiple sonars provide too much information, which, like the video surveillance system, will cause visual fatigue and even misjudgment of users. Therefore, it is necessary to spatially align the multi-image sonar data and perform image fusion to achieve a unified view representation of multiple sonar images with high fidelity, which can not only reduce the user's usage burden, but also provide high-quality data support for automated target recognition and tracking.

[0007] The information disclosed in this background technology section is only intended to enhance the understanding of the overall background of the invention and should not be regarded as an acknowledgment or any form of suggestion that the information constitutes the prior art already known to a person skilled in the art. Summary of the invention

[0008] The object of the present invention is to provide a spatial alignment device for a multi-image sonar system, which can accurately obtain relative position data, acoustic marker detection data and multi-image sonar data.

[0009] Another object of the present invention is to provide an image fusion method for a multi-image sonar system, which can solve the transformation matrix parameters from multiple sonar coordinate systems to the sonar system coordinate system through multiple sets of data, thereby converting multiple sonar images into the same coordinate space to achieve image alignment and fusion.

[0010] To achieve the above-mentioned object, the present invention provides a spatial alignment device for a multi-image sonar system, comprising: a high-precision multi-degree-of-freedom slide rail motion platform, which comprises at least two slide rails parallel to each other and spaced a distance apart, and a first slider group and a second slider group arranged on the at least two slide rails; a multi-image sonar system mounting platform is arranged on the first slider group, and can slide back and forth on the at least two slide rails with the first slider group, and the multi-image sonar system mounting platform comprises: a mounting platform bracket is arranged on the multi-image sonar system mounting platform; and the multi-image sonar system is arranged on the top of the mounting platform bracket; and an acoustic marker mounting platform is arranged on the second slider group, and the acoustic marker mounting platform The platform includes: a driving motor is arranged on a slider on one side of the second slider group; a support block is arranged on the slider on the other side of the second slider group corresponding to the driving motor; one end of the lead screw is connected to the driving motor, and the other end is pivoted on the support block, and the lead screw is vertically arranged with at least two slide rails; an acoustic marker bracket is arranged on the lead screw, and the driving motor drives the lead screw to rotate, and at the same time drives the acoustic marker bracket to reciprocate along the lead screw; and the acoustic marker is arranged on the top of the acoustic marker bracket; wherein the relative position between the acoustic marker mounting platform and the multi-image sonar system mounting platform is adjusted, so that the acoustic marker can be located within the spatial range of the detection beam of the multi-image sonar system without being interfered with or affected by other equipment.

[0011] In a preferred embodiment, the multi-image sonar system mounting platform also includes a horizontal rotation device and a vertical rotation device; the mounting platform bracket is arranged on the horizontal rotation device, and the horizontal rotation device can drive the mounting platform bracket to rotate horizontally within a certain angle range; the multi-image sonar system is arranged on the vertical rotation device, and the vertical rotation device can drive the multi-image sonar system to rotate vertically within a certain angle range; wherein adjusting the horizontal rotation device and the vertical rotation device can enable the multi-image sonar system to emit a detection beam within a certain spatial range.

[0012] In a preferred embodiment, the acoustic marker mounting platform further includes a guide block, which includes a threaded hole. The guide block is connected to the lead screw through the threaded hole. The drive motor drives the lead screw to rotate and simultaneously drives the guide block to reciprocate along the lead screw.

[0013] In a preferred embodiment, the acoustic marker bracket is disposed on a guide block, and the acoustic marker bracket can move together with the guide block.

[0014] In a preferred embodiment, the high-precision multi-degree-of-freedom slide rail motion platform also includes a positioning device and a motion control module; the positioning device is arranged on the multi-image sonar system installation platform; the motion control module is data-connected to the positioning device; wherein the positioning device can transmit a positioning signal to the acoustic marker installation platform, and the relative position data of the positioning signal reflected back by the acoustic marker installation platform is received by the signal receiving device of the positioning device, and the relative position data can be processed by the motion control module to realize the measurement of the sliding and relative position data of the multi-image sonar system and the acoustic marker.

[0015] In a preferred embodiment, the spatial alignment device of the multi-image sonar system also includes a data acquisition system, which includes a relative position data acquisition module and a multi-image sonar system data acquisition module; the relative position data acquisition module is data-connected to the positioning device, and acquires, stores and processes the relative position data received by the signal receiving device; the multi-image sonar system data acquisition module is data-connected to the multi-image sonar system, and the multi-image sonar system data acquisition module is used to acquire, store and process the multi-image sonar data received by the multi-image sonar system.

[0016] In a preferred embodiment, the spatial alignment device of the multi-image sonar system also includes a spatial alignment solution system, whose data is connected to the motion control module, the relative position data acquisition module and the multi-image sonar system data acquisition module, and the spatial alignment solution system is used to annotate the multi-image sonar data and solve the transformation matrix parameters from multiple sonar coordinate systems to the sonar system coordinate system; wherein the sonar coordinate system is {O1, O2,…, Oi}; the sonar system coordinate system is {Ob}; and the matrix parameters are {R1, T1, R2, T2,…, Ri, Ti}.

[0017] In a preferred embodiment, the acoustic marker is an alloy object having a rotationally symmetrical structure.

[0018] To achieve the above another object, the present invention also provides an image fusion method for a multi-image sonar system, which is applied to the aforementioned spatial alignment device, including: placing an acoustic marker within the spatial range of a detection beam of the multi-image sonar system, changing the position and posture of the acoustic marker, and collecting multiple sets of relative position data, acoustic marker detection data and multi-image sonar data through a relative position data acquisition module of a data acquisition system and a multi-image sonar system data acquisition module; determining a multi-image sonar system coordinate system reference, establishing a conversion equation from acoustic marker detection data to a calibration device position, and a conversion equation from a calibration device position to a system coordinate system, respectively solving the transformation matrix parameters {R1, T1, R2, T2, ..., Ri, Ti} from multiple sonar coordinate systems {O1, O2, ..., Oi} to a sonar system coordinate system {Ob} by least squares method, and realizing multiple measurement space conversions of the multi-sonar system by matrix multiplication to complete spatial calibration:

[0019]

[0020] Among them, I bi represents the measurement in the sonar system coordinate system, I i represents the measurement in the i-th sonar coordinate system, R i Represents the rotation matrix from the i-th sonar coordinate system to the sonar system coordinate system, T i Represents the translation matrix from the i-th sonar coordinate system to the sonar system coordinate system; based on the spatial calibration, the multi-image sonar data is represented in a unified space using the spatial bilinear interpolation method:

[0021] I′(x,y)=b[aI(i+1,j)+(1-a)I(i+1,j+1)]+(1-b)[aI(i,j)+(1-a)I(i,j+1)]

[0022] Among them, I′(x,y) is the point to be interpolated, and I(i,j) is the original image data point. After determining the unified image size, the bilinear interpolation method is used to represent multiple image sonar data as data of the same dimension to achieve spatial alignment. A fusion model including L1 generalization and total variation regularization is established to obtain the fused image by minimizing the model error:

[0023]

[0024] Among them, I f refers to the fused image, I 1 This refers to the first sonar image. 2 Refers to the image of the second sonar; ||I f -I 1 || represents L1 generalized regularization, which refers to the sum of the absolute values ​​of each element in the vector, and is used to achieve high fidelity based on the first sonar image;

[0025] Item 2 represents the total variation, represents the gradient operator, which is used to maintain the edge information of the second sonar image; λ is the regularization coefficient, which is used to balance the high fidelity and image edge preservation performance after fusion.

[0026] In a preferred embodiment, the positioning signal transmitting device of the positioning device adopts a laser, and the signal receiving device adopts a photoelectric sensor.

[0027] Compared with the prior art, the spatial alignment device and image fusion method of the multi-image sonar system of the present invention have the following beneficial effects: the device system proposed in the present invention can synchronously collect information such as the position and posture of the target and the multi-image sonar device, saving manpower and time costs and improving the data accuracy used for spatial alignment. The image fusion method proposed in the present invention can achieve a unified view representation of multi-sonar images with high fidelity, which can not only reduce the user's usage burden, but also provide high-quality data support for automatic target recognition and tracking. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 is a schematic diagram of the three-dimensional structure of a spatial alignment device according to an embodiment of the present invention;

[0029] Figure 2 is a schematic side view of a spatial alignment device according to an embodiment of the present invention;

[0030] Figure 3 is a schematic top view of a multi-image sonar system installation platform according to an embodiment of the present invention;

[0031] Figure 4 is a schematic top view of an acoustic marker installation platform according to an embodiment of the present invention;

[0032] Figure 5 Schematic diagram of communication connection of a spatial alignment device according to an embodiment of the present invention.

[0033] Description of main reference numerals:

[0034] 01- multi-image sonar system installation platform, 011- horizontal rotation device, 012- installation platform bracket, 013- multi-image sonar system, 0131- upper boundary of beam, 0132- lower boundary of beam, 0133- left boundary of beam, 0134- right boundary of beam, 02- acoustic marker installation platform, 021- acoustic marker bracket, 022- acoustic marker, 023- driving motor, 024- guide block, 025- lead screw, 026- support block, 03- high-precision multi-degree-of-freedom slide motion platform, 031- first slider group, 032- second slider group, 033- positioning device, 034- motion control module, 04- data acquisition system, 041- relative position data acquisition module, 042- multi-image sonar system data acquisition module, 05- space alignment solution system. DETAILED DESCRIPTION

[0035] The specific implementation modes of the present invention are described in detail below in conjunction with the accompanying drawings, but it should be understood that the protection scope of the present invention is not limited by the specific implementation modes.

[0036] Unless explicitly stated otherwise, throughout the specification and claims, the term “comprise” or variations such as “include” or “comprising”, etc., will be understood to include the stated elements or components but not to exclude other elements or components.

[0037] like Figures 1 to 5 As shown, a spatial alignment device of a multi-image sonar system according to a preferred embodiment of the present invention mainly comprises: a high-precision multi-degree-of-freedom slide rail motion platform 03, which comprises at least two slide rails parallel to each other and spaced a distance apart, and a first slider group 031 and a second slider group 032 arranged on the at least two slide rails. In this embodiment, the number of the first slider group 031 and the second slider group 032 are both four, but the present invention is not limited thereto. A multi-image sonar system installation platform 01 is arranged on the first slider group 031, and can slide back and forth on at least two slide rails with the first slider group 031. The multi-image sonar system installation platform 01 comprises: a mounting platform bracket 012 arranged on the multi-image sonar system installation platform 01. And a multi-image sonar system 013 is arranged on the top of the mounting platform bracket 012. And an acoustic marker installation platform 02 is arranged on the second slider group 032, and the acoustic marker installation platform 02 comprises: a driving motor 023 is arranged on a slider on one side of the second slider group 032. The support block 026 is correspondingly arranged on the slider on the other side of the second slider group 032 with the drive motor 023. One end of the lead screw 025 is connected to the drive motor 023, and the other end is pivoted on the support block 026, and the lead screw 025 is arranged vertically with at least two slide rails. Two lead screws 025 are also shown in this embodiment, but the present invention is not limited to this. The acoustic marker bracket 021 is arranged on the lead screw 025, and the drive motor 023 drives the lead screw 025 to rotate, and at the same time drives the acoustic marker bracket 021 to reciprocate along the lead screw 025. And the acoustic marker 022 is arranged on the top of the acoustic marker bracket 021. Among them, adjusting the relative position between the acoustic marker mounting platform 02 and the multi-image sonar system mounting platform 01 can make the acoustic marker 022 located within the spatial range of the detection beam of the multi-image sonar system 013 without being interfered with and affected by other equipment.

[0038] In some embodiments, the spatial range of the detection beam generally includes a spatial range of the beam upper boundary 0131, the beam lower boundary 0132, the beam left boundary 0133 and the beam right boundary 0134, see Figure 2 and Figure 5 shown.

[0039] In some embodiments, the acoustic marker 022 of this embodiment is an alloy object with a rotationally symmetrical structure and a uniform material, and the material of the acoustic marker 022 is preferably a metal alloy with a large acoustic target strength. The shape is preferably a rotationally symmetrical cylinder, sphere, or ellipsoidal sphere to ensure that the acoustic target strength and characteristics are similar at all angles.

[0040] In some embodiments, the multi-image sonar system installation platform 01 further includes a horizontal rotation device 011 and a vertical rotation device. The installation platform bracket 012 is arranged on the horizontal rotation device 011, and the horizontal rotation device 011 can drive the installation platform bracket 012 to rotate horizontally within a certain angle range. The multi-image sonar system 013 is arranged on the vertical rotation device, and the vertical rotation device can drive the multi-image sonar system 013 to rotate vertically within a certain angle range. Adjusting the horizontal rotation device 011 and the vertical rotation device can enable the multi-image sonar system 013 to emit a detection beam within a certain spatial range. The horizontal rotation device 011 and the vertical rotation device can be applied to the present invention as long as they are mechanisms that can achieve rotation within a certain angle range, and the present invention is not specifically limited here.

[0041] In some embodiments, the acoustic marker mounting platform 02 further includes a guide block 024, the guide block 024 includes a threaded hole, the guide block 024 is connected to the lead screw 025 through the threaded hole, the drive motor 023 drives the lead screw 025 to rotate, and at the same time drives the guide block 024 to reciprocate along the lead screw 025. The acoustic marker bracket 021 is disposed on the guide block 024, and the acoustic marker bracket 021 can move with the guide block 024.

[0042] In some embodiments, the high-precision multi-degree-of-freedom slide rail motion platform 03 further includes a positioning device 033 and a motion control module 034. The positioning device 033 is disposed on the multi-image sonar system installation platform 01. The motion control module 034 is data-connected to the positioning device 033. The positioning device 033 can transmit a positioning signal to the acoustic marker installation platform 02, and the relative position data reflected by the acoustic marker installation platform 02 is received by the signal receiving device of the positioning device 033. After the relative position data is processed by the motion control module 034, the sliding and relative position data of the multi-image sonar system 013 and the acoustic marker 022 can be measured.

[0043] In some embodiments, the positioning signal transmitting device of the positioning device 033 uses a laser, the signal receiving device uses a photoelectric sensor, and the target position calculation module uses a phase laser ranging principle.

[0044] In some embodiments, the main material of the image sonar system mounting platform and the acoustic marker mounting platform 02 is preferably a material with an acoustic impedance close to that of water, such as a composite material with epoxy resin or polyester resin as a matrix material and glass fiber or carbon fiber as a reinforcing material.

[0045] In some embodiments, the spatial alignment device of the multi-image sonar system 013 further includes a data acquisition system 04, which includes a relative position data acquisition module 041 and a multi-image sonar system data acquisition module 042. The relative position data acquisition module 041 is data-connected to the positioning device 033, and acquires, stores and processes the relative position data received by the signal receiving device. The multi-image sonar system data acquisition module 042 is data-connected to the multi-image sonar system 013, and is used to acquire, store and process the multi-image sonar data received by the multi-image sonar system 013.

[0046] In some embodiments, the spatial alignment device of the multi-image sonar system 013 further includes a spatial alignment solution system 05, whose data is connected to the motion control module 034, the relative position data acquisition module 041 and the multi-image sonar system data acquisition module 042. The spatial alignment solution system 05 is used to annotate the multi-image sonar data and solve the transformation matrix parameters from multiple sonar coordinate systems to the sonar system coordinate system; wherein the sonar coordinate system is {O1, O2, …, Oi}; the sonar system coordinate system is {Ob}; and the matrix parameters are {R1, T1, R2, T2, …, Ri, Ti}.

[0047] To achieve the above another object, the present invention further provides an image fusion method of a multi-image sonar system 013, which is applied as the aforementioned spatial alignment device, including: placing the acoustic marker 022 within the spatial range of the detection beam of the multi-image sonar system 013, changing the position and posture of the acoustic marker 022, collecting multiple sets of relative position data, acoustic marker 022 detection data and multi-image sonar data through the relative position data acquisition module 041 of the data acquisition system 04 and the multi-image sonar system 013 data acquisition module; determining the multi-image sonar system 013 coordinate system reference, establishing a conversion equation from the acoustic marker 022 detection data to the calibration device position, and a conversion equation from the calibration device position to the system coordinate system, respectively solving the transformation matrix parameters {R1, T1, R2, T2, ..., Ri, Ti} from multiple sonar coordinate systems {O1, O2, ..., Oi} to the sonar system coordinate system {Ob} by the least square method, and realizing the conversion of multiple measurement spaces of the multi-sonar system by matrix multiplication to complete the spatial calibration:

[0048]

[0049] Among them, I birepresents the measurement in the sonar system coordinate system, I i represents the measurement in the i-th sonar coordinate system, R i Represents the rotation matrix from the i-th sonar coordinate system to the sonar system coordinate system, T i Represents the translation matrix from the i-th sonar coordinate system to the sonar system coordinate system; based on the spatial calibration, the multi-image sonar data is represented in a unified space using the spatial bilinear interpolation method:

[0050] I′(x,y)=b[aI(i+1,j)+(1-a)I(i+1,j+1)]+(1-b)[aI(i,j)+(1-a)I(i,j+1)]

[0051] Among them, I′(x,y) is the point to be interpolated, and I(i,j) is the original image data point. After determining the unified image size, the bilinear interpolation method is used to represent multiple image sonar data as data of the same dimension to achieve spatial alignment. A fusion model including L1 generalization and total variation regularization is established to obtain the fused image by minimizing the model error:

[0052]

[0053] Among them, I f refers to the fused image, I 1 This refers to the first sonar image. 2 Refers to the image of the second sonar; ||I f -I 1 || represents L1 generalized regularization, which refers to the sum of the absolute values ​​of each element in the vector, and is used to achieve high fidelity based on the first sonar image;

[0054] Item 2 represents the total variation, represents the gradient operator, which is used to maintain the edge information of the second sonar image; λ is the regularization coefficient, which is used to balance the high fidelity and image edge preservation performance after fusion.

[0055] In summary, the spatial alignment device and image fusion method of the multi-image sonar system of the present invention have the following beneficial effects: the device system proposed in the present invention can synchronously collect information such as the position and posture of the target and the multi-image sonar device, save manpower and time costs, and improve the data accuracy used for spatial alignment. The image fusion method proposed in the present invention can achieve a unified view representation of multi-sonar images with high fidelity, which can not only reduce the user's usage burden, but also provide high-quality data support for automatic target recognition and tracking.

[0056] The foregoing description of specific exemplary embodiments of the present invention is for the purpose of illustration and demonstration. These descriptions are not intended to limit the present invention to the precise form disclosed, and it is clear that many changes and variations can be made based on the above teachings. The purpose of selecting and describing the exemplary embodiments is to explain the specific principles of the present invention and its practical application, so that those skilled in the art can realize and utilize various different exemplary embodiments of the present invention and various different selections and changes. The scope of the present invention is intended to be limited by the claims and their equivalents.

Claims

1. A spatial alignment device for a multi-image sonar system, It is characterized in that include: A high-precision multi-degree-of-freedom slide rail motion platform, comprising at least two slide rails parallel to each other and spaced a distance apart, and a first slider group and a second slider group arranged on the at least two slide rails; A multi-image sonar system installation platform, which is arranged on the first slider group and can slide back and forth on the at least two slide rails along with the first slider group, and the multi-image sonar system installation platform includes: A mounting platform bracket, which is arranged on the multi-image sonar system mounting platform; and a multi-image sonar system disposed on top of the mounting platform bracket; and An acoustic marker installation platform is arranged on the second slider group, and the acoustic marker installation platform comprises: A driving motor, which is arranged on a slider on one side of the second slider group; A support block, which is arranged on the slider on the other side of the second slider group corresponding to the driving motor; A lead screw, one end of which is connected to the drive motor and the other end of which is pivotally mounted on the support block, and the lead screw is vertically arranged to the at least two slide rails; an acoustic identification bracket, which is arranged on the lead screw, and the drive motor drives the lead screw to rotate, and at the same time drives the acoustic identification bracket to reciprocate along the lead screw; and An acoustic marker, which is arranged on the top of the acoustic marker bracket; The relative position between the acoustic marker installation platform and the multi-image sonar system installation platform is adjusted so that the acoustic marker is located within the spatial range of the detection beam of the multi-image sonar system without being interfered with or affected by other devices; Wherein, the multi-image sonar system installation platform also includes: A horizontal rotating device, wherein the mounting platform bracket is arranged on the horizontal rotating device, and the horizontal rotating device can drive the mounting platform bracket to rotate horizontally within a certain angle range; and A vertical rotation device, the multi-image sonar system is arranged on the vertical rotation device, and the vertical rotation device can drive the multi-image sonar system to rotate vertically within a certain angle range; wherein adjusting the horizontal rotation device and the vertical rotation device can enable the multi-image sonar system to emit a detection beam within a certain spatial range; The acoustic marker installation platform further includes a guide block, which includes a threaded hole, and the guide block is connected to the lead screw through the threaded hole, and the drive motor drives the lead screw to rotate and drives the guide block to reciprocate along the lead screw at the same time; The acoustic identification bracket is arranged on the guide block, and the acoustic identification bracket can move together with the guide block; The high-precision multi-degree-of-freedom slide rail motion platform also includes: A positioning device, which is arranged on the multi-image sonar system installation platform; and A motion control module, whose data is connected to the positioning device; The positioning device can transmit a positioning signal to the acoustic marker installation platform, and the relative position data of the positioning signal reflected by the acoustic marker installation platform is received by the signal receiving device of the positioning device. The relative position data can be processed by the motion control module to realize the measurement of the sliding and relative position data of the multi-image sonar system and the acoustic marker; The spatial alignment device of the multi-image sonar system also includes a data acquisition system, which includes: a relative position data acquisition module, which is data connected to the positioning device and acquires, stores and processes the relative position data received by the signal receiving device; and A multi-image sonar system data acquisition module, which is data connected to the multi-image sonar system, and the multi-image sonar system data acquisition module is used to collect, store and process the multi-image sonar data received by the multi-image sonar system; The spatial alignment device of the multi-image sonar system also includes a spatial alignment solution system, which is data-connected to the motion control module, the relative position data acquisition module and the multi-image sonar system data acquisition module, and the spatial alignment solution system is used to annotate the multi-image sonar data and solve the transformation matrix parameters from multiple sonar coordinate systems to the sonar system coordinate system; The sonar coordinate system is {O1, O2, …, Oi}; The sonar system coordinate system is {Ob}; and The matrix parameters are { R1, T1, R2, T2 ,… ,Ri, Ti}.

2. The spatial alignment device of the multi-image sonar system according to claim 1, It is characterized in that The acoustic marker is an alloy object with a rotationally symmetrical structure.

3. An image fusion method for a multi-image sonar system, using the spatial alignment device as claimed in claim 1 or 2, It is characterized in that include: Placing the acoustic marker within the spatial range of the detection beam of the multi-image sonar system, changing the position and posture of the acoustic marker, and collecting multiple sets of relative position data, acoustic marker detection data and multi-image sonar data through the relative position data acquisition module of the data acquisition system and the multi-image sonar system data acquisition module; Determine the coordinate system benchmark of the multi-image sonar system, establish the conversion equation from the acoustic marker detection data to the calibration device position and the conversion equation from the calibration device position to the system coordinate system, respectively solve the transformation matrix parameters {R1, T1, R2, T2,…,Ri,Ti} from multiple sonar coordinate systems {O1, O2, …, Oi} to the sonar system coordinate system {Ob} by the least squares method, and realize the conversion of multiple measurement spaces of the multi-sonar system by matrix multiplication to complete the spatial calibration: , in, represents the measurement in the sonar system coordinate system, represents the measurement in the i-th sonar coordinate system, Represents the rotation matrix from the i-th sonar coordinate system to the sonar system coordinate system, Represents the translation matrix from the i-th sonar coordinate system to the sonar system coordinate system; Based on the spatial calibration, the spatial bilinear interpolation method is used to unify the multi-image sonar data into a unified spatial representation: , in, is the point to be interpolated, is the original image data point; After determining the uniform image size, multiple image sonar data are represented as data of the same dimension through bilinear interpolation method to achieve spatial alignment; A fusion model including L1 generalization and total variation regularization is established, and the fused image is obtained by minimizing the model error: , in, refers to the fused image, This refers to the first sonar image. refers to the image of the second sonar;‖ I f - I 1 ‖ represents L1 generalized regularization, which refers to the sum of the absolute values ​​of each element in the vector, and is used to achieve high fidelity based on the first sonar image; Item 2 represents the total variation, represents the gradient operator, which is used to maintain the edge information of the second sonar image; is the regularization coefficient, which is used to balance the high fidelity and image edge preservation performance after fusion.

4. The image fusion method of the multi-image sonar system as claimed in claim 3, It is characterized in that The positioning signal transmitting device of the positioning device adopts a laser, and the signal receiving device adopts a photoelectric sensor.

Citation Information

Patent Citations

  • Feature density clustering and normal distribution transformation based side-scan sonar registration method

    CN105405146A

  • Underwater riprap real-time monitoring system based on three-dimensional point cloud system and working method thereof

    CN108614270A

  • Underwater buried object identification and positioning method based on sonar image processing

    CN112529072A

  • Self-locating system and methods for multistatic active coherent sonar

    US10379218B1