Underwater non-contact optical communication method and system and storage medium

By using grayscale processing and brightness adjustment technology of colored light spot patterns in underwater wireless optical communication systems, the problem of application distance and orientation measurement accuracy in underwater wireless optical communication is solved, and communication quality and reliability are improved.

CN119030610APending Publication Date: 2024-11-26XIDIAN UNIV +1
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202410930272.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-11
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The existing underwater wireless optical communication methods have limitations in application distance and azimuth measurement accuracy, resulting in poor communication effects, especially due to the attenuation of the visible light band and the brightness of the guide light.

Method used

By sending guide light and communication light signals between underwater communication equipment, using pixel grayscale processing and spot judgment of colored spot patterns, the brightness information of the guide light is calculated, the brightness of the guide light is adjusted to determine the orientation information, and Adjust the position and orientation according to the preset attitude estimation algorithm to establish a stable contactless optical communication link.

Benefits of technology

It improves the quality and reliability of underwater wireless optical communication, expands the application distance, avoids the problems of guided light interference and inaccurate brightness, and achieves more stable two-way data transmission.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119030610A_ABST
    Figure CN119030610A_ABST
Patent Text Reader

Abstract

The invention provides an underwater non-contact optical communication method and system and a storage medium. The underwater non-contact optical communication method comprises the following steps: a first communication device judges a guide light spot according to a gray processing result to obtain the guide light spot, and calculates the brightness information of guide light based on the gray processing result and the guide light spot; determining azimuth information of the second communication equipment according to the guide light spot and a preset attitude estimation algorithm; according to the invention, the pixel-based gray processing is carried out on the colored light spot pattern, the guide light spot judgment is carried out based on the gray processing result to obtain the guide light spot, and the brightness adjustment of the guide light is carried out on the basis of the guide light spot. The interference influence of the second communication optical signal and the problem of inaccurate positioning of the azimuth information of the second communication equipment caused by too bright or too dark guide light are avoided; and finally, the communication quality between the first communication equipment and the second communication equipment is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of underwater wireless communication, and in particular to an underwater non-contact optical communication method, system and storage medium. Background Art

[0002] At present, there are two main ways for humans to observe the deep sea, one is the seabed observation network, and the other is the underwater mobile observation platform. Among them, the seabed observation network is to deploy fixed observation nodes at the bottom of the ocean, and connect each node through cables to form a network. In this network, the data obtained by each observation node is transmitted to the land through cables, thereby completing the transmission and collection of information. The underwater mobile observation platform uses manned submersibles, underwater remote-controlled submersibles, underwater autonomous submersibles, underwater gliders and other mobile machine platforms to observe different marine targets. After completing the mission, this mobile observation platform is generally salvaged back to the ship or land, and the observation data is downloaded from it. With the continuous expansion of the ocean observation space, the observation data of the mobile platform is integrated into the observation network through the docking station of the seabed observation network, so that the two observation platforms can exchange data information and realize information sharing, which helps to optimize the information transmission method of the two observation methods and improve the timeliness of information.

[0003] In the existing technology, three main methods are adopted to realize the data interaction between the seabed observation network and the underwater mobile platform, namely, hydroacoustic communication, wired communication and wireless optical communication. Hydroacoustic communication is to use sound waves to establish a wireless transmission link between the underwater mobile observation platform and the underwater docking station, which can achieve a transmission distance of kilometers. However, due to the limitation of the bandwidth of sound waves, the communication rate is usually in the order of Kbps, which has limitations in large-capacity data transmission. Wired communication is to use a wet plug connector to establish a wired communication link between the mobile platform and the docking station when the underwater mobile observation platform is close to the underwater docking station. The reliability and success rate of this method are restricted by the performance of the wet plug connector. Once the connector fails to plug or the lack of watertightness leads to leakage, the information transmission will fail. Underwater wireless optical communication is also used when the underwater mobile observation platform is close to the underwater docking station. This method uses visible light as the information carrier and seawater as the medium for information transmission. This non-contact optical communication method has the advantage of high transmission bandwidth and can improve data transmission efficiency.

[0004] In the actual marine environment, the primary difficulty faced by this wireless optical communication method is to make the two communication terminals enter each other's communication coverage and align with each other to establish a two-way signal transmission link. In the existing methods, the underwater mobile observation platform generally adjusts its own position and orientation through acoustic guidance and optical guidance methods, so that the optical communication equipment it carries is aligned with the optical communication equipment in the underwater docking station and establishes a transmission link. When the distance between the mobile observation platform and the underwater docking station is far, the guidance method adopted is acoustic detection and positioning; when the distance is close, the orientation of the docking station is accurately measured by optical vision. For the optical vision measurement method, an underwater camera is generally installed on the mobile observation platform, and a light array is installed on the underwater docking station. The shape of the light pattern is captured by the camera, and the relative orientation of the mobile platform and the docking station is measured to provide a basis for attitude adjustment. This optical measurement method can provide fast and accurate link orientation information for the wireless optical communication system, so as to adjust and optimize the link orientation in real time during the communication process and ensure the stability of information transmission. However, since the light used for this optical guidance and the light waves used by the underwater wireless optical communication system are both in the visible light band, the light spot formed by the communication light in the camera will affect the accuracy of the guidance measurement. In the related art, the communication light of the underwater wireless optical communication system and the guidance light used for optical guidance operate in different bands, and the colorimetric method is used to enable the camera to distinguish the two light spots, thereby eliminating the interference of the communication light [see patent "A method for measuring the posture of cooperative targets in underwater wireless optical communication", patent application number 202310905660.3". However, due to the large difference in the attenuation coefficients of different light waves in water, as the transmission distance increases, the blue-green band components in the light wave increase, so that the difference in the colorimetric characteristics of the guidance light and the communication light will be reduced, which limits the application distance of this method. In addition, when the underwater optical guidance device is working, once the light intensity installed in the docking station forms a light spot brightness that is too high or too low in the camera of the underwater mobile platform, it will affect the accuracy of the azimuth measurement.

[0005] Therefore, the existing data interaction method between the seabed observation network and the underwater mobile platform may cause poor communication between the two due to the limitation of its application distance and the inaccuracy of azimuth measurement accuracy. Summary of the invention

[0006] In order to solve the above problems existing in the prior art, the present invention provides an underwater non-contact optical communication method, system and storage medium.

[0007] The technical problem to be solved by the present invention is achieved through the following technical solutions:

[0008] In a first aspect, the present invention provides an underwater non-contact optical communication method, comprising:

[0009] The second communication device sends a guide light and a second communication light signal into the water;

[0010] The first communication device photographs the guide light to obtain a color spot pattern and performs pixel-based grayscale processing on the color spot pattern, and determines the guide spot based on the grayscale processing result to obtain the guide spot;

[0011] The first communication device calculates the brightness information of the guide light based on the result of grayscale processing and the guide light spot; determines the orientation information of the second communication device according to the guide light spot and a preset attitude estimation algorithm;

[0012] The first communication device adjusts its position and orientation according to the orientation information so that the first communication device is within a preset energy threshold of the second communication device; when within the preset energy threshold, receives the second communication optical signal and sends the first communication optical signal to the second communication device; the first communication optical signal carries brightness information;

[0013] The second communication device obtains the first communication optical signal, and adjusts the brightness of its own guide light based on the brightness information to obtain the guide adjustment light;

[0014] The second communication device and the first communication device complete non-contact optical communication based on the first communication optical signal and the second communication optical signal under the guidance adjustment light;

[0015] Among them, the second communication device is a fixed observation node device, and the first communication device is an operation observation device.

[0016] Optionally, photographing the guide light to obtain a color spot pattern and performing pixel-based grayscale processing on the color spot pattern, and performing a guide spot judgment based on the grayscale processing result to obtain the guide spot, including:

[0017] Shoot the guide light to get the color spot pattern;

[0018] Establishing a coordinate system with a preset position as the origin in the spot pattern, and obtaining the RGB pixel value of each pixel in the spot pattern;

[0019] A grayscale image is obtained based on a preset grayscale calculation formula and RGB pixel values;

[0020] The grayscale image is subjected to Gaussian filtering, binarization, and Hough change detection in sequence to obtain multiple spot center coordinates and spot radius;

[0021] A guiding light spot decision process is performed on multiple light spots based on the center coordinates of the light spots to obtain a guiding light spot.

[0022] Optionally, the preset grayscale calculation formula is expressed as:

[0023] g(x,y)=0.299R(x,y)+0.587G(x,y)+0.114B(x,y);

[0024] Among them, g(x,y) represents the grayscale value of the grayscale image at the coordinate (x,y), x represents the horizontal coordinate of the spot pattern, y represents the vertical coordinate of the spot pattern, R(x,y) represents the pixel value at the coordinate (x,y) under the R channel, G(x,y) represents the pixel value at the coordinate (x,y) under the G channel, and B(x,y) represents the pixel value at the coordinate (x,y) under the B channel.

[0025] Optionally, when the number of light spot center coordinates is equal to the number of guide lights plus 1, a guide light spot determination process is performed on a plurality of light spots based on the light spot center coordinates to obtain a guide light spot, including:

[0026] S201, calculating the distances from the center coordinates of all light spots to a preset position to obtain a plurality of first distances;

[0027] S202, taking the center coordinate of the light spot corresponding to the maximum value of the multiple first distances as the initial guidance coordinate, and adding the initial guidance coordinate to the preset guidance set to obtain the current guidance set; taking the center coordinate of the light spot other than the current guidance set as the current coordinate to be processed;

[0028] S203, calculating the unit vector of the initial guidance coordinate relative to the preset position to obtain a first unit vector; calculating the unit vector of the current coordinate to be processed relative to the initial guidance coordinate to obtain a second unit vector;

[0029] S204, rotating the first unit vector clockwise, and adding the light spot center coordinates corresponding to the first overlap of the second unit vector with the first unit vector to the current guide set; and taking the light spot center coordinates other than the current guide set as the current coordinates to be processed;

[0030] S205, performing unit vector calculation on the center coordinates of the light spot most recently added in the current guide set relative to the center coordinates of the light spot most recently added, to obtain a current unit vector; calculating the unit vector between the current coordinate to be processed and the center coordinates of the light spot most recently added in the current guide set as the current comparison unit vector;

[0031] S206, rotating the current unit vector clockwise, adding the light spot center coordinates corresponding to the first overlap between the current control unit vector and the current unit vector to the current guide set; taking the light spot center coordinates other than the current guide set as the current coordinates to be processed;

[0032] S207, looping through steps S205-S206 until the number of light spot center coordinates in the current guiding set is equal to the number of guiding lights, and taking the light spot center coordinates in the current guiding set as guiding light spots;

[0033] The preset position is the upper left corner of the light spot pattern.

[0034] Optionally, the brightness information of the guide light is obtained based on the result of grayscale processing and the guide light spot calculation, including:

[0035] Based on the grayscale image, the grayscale mean within the spot radius is calculated for each guiding light spot, and the grayscale mean is used as the brightness information of the guiding light.

[0036] Optionally, determining the position information of the second communication device according to the guide light spot and a preset attitude estimation algorithm includes:

[0037] Calculate the rotation matrix R and transformation vector t of the second communication device relative to the first communication device according to the guide light spot and the PNP algorithm;

[0038] Based on the rotation matrix R and the transformation vector t and a preset orientation calculation formula, obtaining orientation information of the second communication device;

[0039] The position information includes: the distance d of the second communication device relative to the first communication device, the yaw angle θ of the second communication device relative to the first communication device Yaw , the elevation angle θ of the second communication device relative to the first communication device Pitch and the roll angle θ of the second communication device relative to the first communication device Roll .

[0040] Optionally, the preset orientation calculation formula is expressed as:

[0041]

[0042] θ Pitch =arcsin(-R 31 );

[0043]

[0044] Among them, R mn Represents the upper left m×n submatrix of R, m represents the row of the matrix rotation matrix R, and n represents the column of the matrix rotation matrix R.

[0045] Optionally, the first communication device adjusts its position and orientation according to the position information so that the first communication device is within a preset energy threshold of the second communication device, including:

[0046] The first communication device adjusts its position and orientation according to the orientation information;

[0047] The distance d of the second communication device relative to the first communication device and the yaw angle θ of the second communication device relative to the first communication device are Yaw , the elevation angle θ of the second communication device relative to the first communication device Pitch and the roll angle θ of the second communication device relative to the first communication device Roll are all less than the preset threshold.

[0048] In a second aspect, the present invention provides an underwater non-contact optical communication system, the underwater non-contact optical communication system comprising: a second communication device and a first communication device;

[0049] The second communication device is used to send a guide light and a second communication light signal into the water; obtain the first communication light signal, and complete the brightness adjustment of its own guide light based on the brightness information to obtain a guide adjustment light; under the guide adjustment light, complete non-contact optical communication based on the first communication light signal;

[0050] The first communication device is used to photograph the guide light to obtain a colored light spot pattern and perform pixel-based grayscale processing on the colored light spot pattern, and to determine the guide light spot based on the result of the grayscale processing to obtain the guide light spot; to obtain the brightness information of the guide light based on the result of the grayscale processing and the guide light spot calculation; to determine the orientation information of the second communication device according to the guide light spot and a preset posture estimation algorithm; to adjust its own position and orientation according to the orientation information, so that the first communication device is within the preset energy threshold of the second communication device; when within the preset energy threshold, to receive the second communication light signal and to send the first communication light signal to the second communication device; and to complete the contactless optical communication based on the second communication light signal.

[0051] In a third aspect, the present invention provides a storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the underwater non-contact optical communication method of the first aspect are executed.

[0052] The invention provides an underwater non-contact optical communication method, system and storage medium. A method for underwater non-contact optical communication includes: a second communication device sends a guide light and a second communication light signal into the water; a first communication device shoots the guide light to obtain a color spot pattern and performs pixel-based grayscale processing on the color spot pattern, and determines the guide light spot based on the result of the grayscale processing to obtain the guide light spot; the first communication device obtains the brightness information of the guide light based on the result of the grayscale processing and the guide light spot calculation; the orientation information of the second communication device is determined according to the guide light spot and a preset posture estimation algorithm; the first communication device adjusts its own position and orientation according to the orientation information, so that the first communication device is within the preset energy threshold of the second communication device; when it is within the preset energy threshold, it receives the second communication light signal and sends the first communication light signal to the second communication device; the first communication light signal carries brightness information; the second communication device obtains the first communication light signal, and completes the brightness adjustment of its own guide light based on the brightness information to obtain the guide adjustment light; the second communication device and the first communication device complete non-contact optical communication based on the first communication light signal and the second communication light signal under the guide adjustment light; wherein the second communication device is a fixed observation node device, and the first communication device is a running observation device. In the present invention, a guiding light spot is obtained by performing pixel-based grayscale processing on the colored light spot pattern and judging the guiding light spot based on the result of the grayscale processing, and the brightness of the guiding light is adjusted based on the guiding light spot, thereby avoiding the interference of the second communication optical signal and the problem of inaccurate positioning of the azimuth information of the second communication device caused by the guiding light being too bright or too dark, thereby improving the communication quality between the first communication device and the second communication device.

[0053] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 A schematic diagram of a flow chart of an underwater non-contact optical communication method provided by an embodiment of the present invention;

[0055] Figure 2 A schematic diagram of the structure of an underwater non-contact optical communication system provided by an embodiment of the present invention;

[0056] Figure 3 A schematic structural diagram of a simulation test system for underwater non-contact optical communication provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0057] The present invention is further described in detail below with reference to specific embodiments, but the embodiments of the present invention are not limited thereto.

[0058] In order to improve the communication quality between a first communication device and a second communication device, an embodiment of the present invention provides an underwater non-contact optical communication method. Figure 1 A schematic diagram of a flow chart of an underwater non-contact optical communication method provided by an embodiment of the present invention. Figure 1 As shown, the method includes:

[0059] S101. The second communication device sends a guide light and a second communication optical signal into the water.

[0060] S102: The first communication device photographs the guide light to obtain a color light spot pattern and performs pixel-based grayscale processing on the color light spot pattern, and determines the guide light spot based on the result of the grayscale processing to obtain the guide light spot.

[0061] Figure 2 The schematic diagram of the structure of an underwater non-contact optical communication system provided by an embodiment of the present invention. The first communication device is located on an underwater mobile observation platform, can move freely in the water and establish a two-way wireless optical communication transmission link with the second communication device. Figure 2 As shown, the first communication device is mainly composed of an underwater mobile robot, an underwater camera, an underwater image processing module, a first data fusion module, and a first wireless optical communication terminal. The functions of each module are as follows:

[0062] Underwater mobile robot: As a carrier of the underwater camera, underwater image processing module, first data fusion module, and first wireless optical communication terminal, it can adjust its own position and orientation according to the relative position of the first communication device and the second communication device provided by the underwater image processing module. The underwater mobile robot can choose to use a platform that can move underwater, such as a manned submersible, an underwater remote-controlled submersible, an underwater autonomous submersible, and an underwater glider.

[0063] Underwater camera: used to photograph the underwater guide light array in the second communication device to form a colorful light spot pattern.

[0064] Underwater image processing module: used to analyze and process the light spot pattern captured by the underwater camera, so as to obtain the brightness information of the underwater guide light array and its relative position with the underwater camera. And this relative position is used as the orientation information of the second communication device.

[0065] The first data fusion module: fuses the different types of data carried by the underwater mobile robot and the brightness information of the underwater guide light array in the second communication device obtained by the underwater image processing module to form the data information of the first communication device and sends it to the first wireless optical communication terminal; and sends the data information of the second communication device received by the first wireless optical communication terminal to the underwater mobile robot;

[0066] The first wireless optical communication terminal includes a first transmitting unit and a first receiving unit, wherein the first transmitting unit can send data information in the first communication device to the second communication device through a first communication optical signal, and the first receiving unit can receive a second communication optical signal from the second communication device. The first transmitting unit, the first receiving unit and the underwater camera are all oriented in the same direction. An optical filter is added to the first receiving unit to receive only the optical waves in the wavelength range of the second communication optical signal.

[0067] The second communication device is fixedly placed underwater and can establish a two-way transmission link with the first communication device. Figure 2 As shown, the second communication equipment is mainly composed of an underwater data terminal, an underwater guide light array, a light brightness control module, a second data fusion module, and a second wireless optical communication terminal.

[0068] Underwater data terminal: connected to the seabed observation network, capable of storing data from the seabed observation network and sending it out through the second communication device, and capable of sending data information obtained by the second communication device to the seabed observation network.

[0069] Underwater guide light array: used to send guide lights to the first communication device, mainly composed of N underwater guide lights (N≧4), which are coplanar and distributed on the vertices of the convex polygon. The guide light array uses LED as a light source, and the optical wavelength used is greater than the communication optical signal wavelength used by the first wireless optical communication terminal and the second wireless optical communication terminal.

[0070] Light brightness control module: used to control the brightness of the underwater guidance light array.

[0071] The second data fusion module: fuses different types of data in the underwater data terminal to form data information of the second communication device and sends it to the second wireless optical communication terminal; and sends the data information of the first communication device received by the second wireless optical communication terminal to the underwater data terminal, and sends the brightness information of the underwater guide light array therein to the light brightness control module;

[0072] The second wireless optical communication terminal: comprises a second transmitting unit and a second receiving unit, wherein the second transmitting unit transmits the data information in the second communication device to the first communication device via the second communication optical signal, and the second receiving unit can receive the first communication optical signal from the first communication device. The second wireless optical communication terminal is coplanar with the underwater guide light array and is located inside the convex polygon surrounded by the guide lights; the orientation of the second transmitting unit and the second receiving unit is consistent with the underwater guide light array. An optical filter is added to the second receiving unit to only receive light waves in the wavelength range of the first communication optical signal.

[0073] In step S101, the second communication device turns on N guide lights (N≧4) in the underwater guide light array, the second transmitting unit and the second receiving unit of the second wireless optical communication terminal, and sends the guide light and the second communication optical signal into the water. The wavelength of the guide light is greater than the working wavelength of the second communication optical signal and the first optical signal. In addition, the N guide lights in the guide light array form a convex polygon, each guide light is located at the vertex of the convex polygon, and the second wireless optical communication terminal for transmitting the second communication optical signal is coplanar with the guide light and is located inside the convex polygon.

[0074] Optionally, S102 may specifically include:

[0075] Shoot the guide light to get the color spot pattern;

[0076] Establishing a coordinate system with a preset position as the origin in the spot pattern, and obtaining the RGB pixel value of each pixel in the spot pattern;

[0077] A grayscale image is obtained based on a preset grayscale calculation formula and RGB pixel values;

[0078] The grayscale image is subjected to Gaussian filtering, binarization, and Hough change detection in sequence to obtain multiple spot center coordinates and spot radius;

[0079] A guiding light spot decision process is performed on multiple light spots based on the center coordinates of the light spots to obtain a guiding light spot.

[0080] In the embodiment of the present invention, a right-handed coordinate system is established with the upper left corner of the spot pattern as the origin, the horizontal direction is the x-axis, and the vertical direction is the y-axis, to obtain the coordinates of each pixel in the spot pattern and the RGB pixel value at each coordinate.

[0081] Optionally, the preset grayscale calculation formula is expressed as:

[0082] g(x,y)=0.299R(x,y)+0.587G(x,y)+0.114B(x,y);

[0083] Among them, g(x,y) represents the grayscale value of the grayscale image at the coordinate (x,y), x represents the horizontal coordinate of the spot pattern, y represents the vertical coordinate of the spot pattern, R(x,y) represents the pixel value at the coordinate (x,y) under the R channel, G(x,y) represents the pixel value at the coordinate (x,y) under the G channel, and B(x,y) represents the pixel value at the coordinate (x,y) under the B channel.

[0084] Optionally, when the number of light spot center coordinates is equal to the number of guide lights plus 1, a guide light spot determination process is performed on a plurality of light spots based on the light spot center coordinates to obtain a guide light spot, including:

[0085] S201, calculating the distances from the center coordinates of all light spots to a preset position to obtain a plurality of first distances;

[0086] S202, taking the center coordinate of the light spot corresponding to the maximum value of the multiple first distances as the initial guidance coordinate, and adding the initial guidance coordinate to the preset guidance set to obtain the current guidance set; taking the center coordinate of the light spot other than the current guidance set as the current coordinate to be processed;

[0087] S203, calculating the unit vector of the initial guidance coordinate relative to the preset position to obtain a first unit vector; calculating the unit vector of the current coordinate to be processed relative to the initial guidance coordinate to obtain a second unit vector;

[0088] S204, rotating the first unit vector clockwise, and adding the light spot center coordinates corresponding to the first overlap of the second unit vector with the first unit vector to the current guide set; and taking the light spot center coordinates other than the current guide set as the current coordinates to be processed;

[0089] S205, performing unit vector calculation on the center coordinates of the light spot most recently added in the current guide set relative to the center coordinates of the light spot most recently added, to obtain a current unit vector; calculating the unit vector between the current coordinate to be processed and the center coordinates of the light spot most recently added in the current guide set as the current comparison unit vector;

[0090] S206, rotating the current unit vector clockwise, adding the light spot center coordinates corresponding to the first overlap between the current control unit vector and the current unit vector to the current guide set; taking the light spot center coordinates other than the current guide set as the current coordinates to be processed;

[0091] S207, looping through steps S205-S206 until the number of light spot center coordinates in the current guiding set is equal to the number of guiding lights, and taking the light spot center coordinates in the current guiding set as guiding light spots;

[0092] The preset position is the upper left corner of the light spot pattern.

[0093] When the number of the light spot center coordinates is equal to the number of guide lights, the currently acquired color light spot pattern is used as the guide light spot.

[0094] In addition, when the number of the center coordinates of the light spots is less than the number of the guide lights, it is considered that the currently acquired color light spot pattern is invalid, and S102 is executed again.

[0095] It should be noted that the calculation of the unit vector is as follows:

[0096]

[0097] Among them, (xl ,y l ) represents the center coordinate of the first spot in the current guidance set, (x m ,y m ) represents the center coordinate of the second spot in the current guidance set, (μ xl ,μ yl ) means (x l ,y l ) and (x m ,y m ) is the unit vector between .

[0098] Optionally, the brightness information of the guide light is obtained based on the result of grayscale processing and the guide light spot calculation, including:

[0099] Based on the grayscale image, the grayscale mean within the spot radius is calculated for each guiding light spot, and the grayscale mean is used as the brightness information of the guiding light.

[0100] S103: The first communication device calculates the brightness information of the guide light based on the result of the grayscale processing and the guide light spot; and determines the orientation information of the second communication device according to the guide light spot and a preset posture estimation algorithm.

[0101] Optionally, determining the position information of the second communication device according to the guide light spot and a preset attitude estimation algorithm includes:

[0102] Calculate the rotation matrix R and transformation vector t of the second communication device relative to the first communication device according to the guide light spot and the PNP algorithm;

[0103] Based on the rotation matrix R and the transformation vector t and a preset orientation calculation formula, obtaining orientation information of the second communication device;

[0104] The position information includes: the distance d of the second communication device relative to the first communication device, the yaw angle θ of the second communication device relative to the first communication device Yaw , the elevation angle θ of the second communication device relative to the first communication device Pitch and the roll angle θ of the second communication device relative to the first communication device Roll .

[0105] Optionally, the preset orientation calculation formula is expressed as:

[0106]

[0107] θ Pitch =arcsin(-R 31 );

[0108]

[0109] Among them, Rmn Represents the upper left m×n submatrix of R, m represents the row of the matrix rotation matrix R, and n represents the column of the matrix rotation matrix R.

[0110] S104. The first communication device adjusts its own position and orientation according to the orientation information so that the first communication device is within a preset energy threshold of the second communication device; when within the preset energy threshold, receives the second communication optical signal and sends the first communication optical signal to the second communication device; the first communication optical signal carries brightness information.

[0111] It should be noted that, in the embodiment of the present invention, making the first communication device within the preset energy threshold of the second communication device may specifically be making the amplitude of the optical signal detected by the first communication device not less than the preset amplitude threshold.

[0112] The underwater mobile robot adjusts its own position and orientation according to the orientation information of the second communication device calculated in S103, so that the first communication device and the second communication device are within the communication coverage of each other, and the first wireless optical communication terminal in the first communication device can receive the signal from the second wireless optical communication terminal of the second communication device, and the amplitude of the signal is greater than a preset amplitude.

[0113] Specifically, the first communication device adjusts its position and orientation according to the azimuth information; so that the distance d of the second communication device relative to the first communication device and the yaw angle θ of the second communication device relative to the first communication device Yaw , the elevation angle θ of the second communication device relative to the first communication device Pitch and the roll angle θ of the second communication device relative to the first communication device Roll are all less than the preset threshold.

[0114] S105. The second communication device obtains the first communication optical signal, and adjusts the brightness of its own guide light based on the brightness information to obtain a guide adjustment light.

[0115] S106: The second communication device and the first communication device complete non-contact optical communication based on the first communication optical signal and the second communication optical signal under the guidance adjustment light.

[0116] In S105, the first communication device turns on the first wireless optical communication terminal, sends a first communication optical signal into the water, and establishes a bidirectional transmission link with the second wireless optical communication terminal in the second communication device. The first communication optical signal and the second communication optical signal have the same operating wavelength and operate in half-duplex mode, or they may have different operating wavelengths, for example, operate in half-duplex or full-duplex mode.

[0117] In addition, when the first wireless optical communication terminal and the second wireless optical communication terminal receive optical signals, optical filters are added to the receiving units, so that the first communication optical signal and the second communication optical signal can pass through the optical filter, while the guide light cannot pass through the optical filter.

[0118] The first communication device and the second communication device perform bidirectional data transmission, and transmit the data information in the first communication device to the second communication device through the first communication optical signal, and transmit the data information in the second communication device to the first communication device through the second communication optical signal. The data information of the first communication device is obtained by fusing different types of data in the underwater mobile robot and the brightness information of the guide light obtained by the underwater image processing module through the first data fusion module. After the data information reaches the second communication device, it is transmitted to the underwater data terminal and the light brightness control module in the second communication device respectively through the second data fusion module.

[0119] The light brightness control module in the second communication device obtains the guide light brightness information from the data information in the first communication device, and adjusts the brightness of the underwater guide light array accordingly to make its brightness in the optimal state. Specifically, it is achieved by adjusting the duty cycle of the pulse width modulation (PWM) signal output by the light brightness control module, and the frequency of the PWM signal is not less than 1KHz. The adjustment process specifically includes the following steps:

[0120] 1. The light brightness control module reads the brightness information of the guide light from the data information in the first communication device, and compares it with the preset maximum brightness information and minimum brightness information;

[0121] 2. According to the brightness information comparison result, multiple guide lights are adjusted respectively. When the brightness information of the guide light is less than the preset minimum brightness information, the duty cycle of the PWM signal output by the corresponding guide light brightness control module is increased; when the brightness information of the light is greater than the preset maximum brightness information, the duty cycle of the PWM signal output by the corresponding light brightness control module is reduced; otherwise, the output duty cycle of the PWM signal is kept unchanged;

[0122] 3. The guide light uses LED as the light source. The PWM signal can control the on and off of the driving current loaded in the LED. Therefore, the link of the guide light can be adjusted by adjusting the output duty cycle of the PWM signal.

[0123] Among them, the second communication device is a fixed observation node device, and the first communication device is an operation observation device.

[0124] Compared with the traditional underwater wireless optical communication, the present invention introduces the optical guidance method based on visual measurement into the optical communication system, and a communication terminal is placed on the underwater robot and can move freely. This system can provide real-time relative posture information for the underwater wireless optical communication terminal, and the position and orientation of the robot can be controlled accordingly to help establish a stable underwater two-way wireless optical communication link, thereby increasing the stability and reliability of the underwater wireless optical communication link. Secondly, when the present invention uses the light pattern captured by the camera to determine the relative orientation of the two communication terminals, since the wireless optical communication terminal is located inside the polygon surrounded by the guide light array, the guide light and the communication light signal can be identified by the light spot position in the camera-captured picture, thereby avoiding the influence of the communication light signal on the optical guidance. Compared with the existing method of using the principle of colorimetry to identify the guide light and the communication light signal, this method can be applied to a longer communication distance. Finally, when the wireless optical communication terminal receives the light signal, due to the processing method of the present invention, an optical filter is added to the front end of the photoelectric detector of the received signal, so that the guide light cannot enter the communication terminal, thereby avoiding the interference of the guide light on the wireless optical communication system. This enables the communication system and the optical guidance system to work simultaneously. Therefore, the light brightness information captured by the camera in the optical guidance system can be transmitted to the guidance light array through a wireless optical communication link, so that it can adjust its own brightness in real time to increase the measurement accuracy of the guidance system. This enables the two-way data transmission function and the posture measurement function within the communication system to work together, which helps to monitor and optimize the status of the communication system and the optical guidance system in real time.

[0125] An embodiment of the present invention provides an underwater contactless optical communication method. In the embodiment of the present invention, a guide light spot is obtained by performing pixel-based grayscale processing on a colored light spot pattern and judging a guide light spot based on the result of the grayscale processing. The brightness of the guide light is adjusted based on the guide light spot, thereby avoiding the interference of the second communication optical signal and the problem of inaccurate positioning of the azimuth information of the second communication device caused by the guide light being too bright or too dark. Ultimately, the communication quality between the first communication device and the second communication device is improved.

[0126] In order to verify the underwater non-contact optical communication method of the present invention, a simulation experiment was also conducted in this embodiment, as follows:

[0127] Figure 3 The schematic diagram of the structure of the underwater non-contact optical communication simulation test system provided by the embodiment of the present invention. Figure 3 As shown in the figure, the simulation test system mainly consists of two simulation devices:

[0128] The first simulation device includes a rotating bracket, a network camera 1#, an underwater camera, a computer 1#, a switch 1#, and an underwater wireless optical communication 1#, wherein the underwater wireless optical communication 1# and the underwater camera are coplanar and face the same direction. The rotating bracket simulates the posture adjustment function of the underwater robot and can rotate horizontally and move; the network camera 1# can generate network video data, simulating the data information carried by the underwater robot; the switch 1# simulates the first data fusion module, which can fuse the data in the computer 1# and the network camera 1# together with the network protocol and transmit and receive through the underwater wireless optical communication 1#; the computer 1# can collect the pictures obtained by the underwater camera and simulate the image processing module to process them, and the computer 1# can be used to display the video information of the network camera 2# in the second simulation device to simulate the data receiving and storage function of the underwater mobile robot.

[0129] The second simulation device includes an underwater guide light array (consisting of underwater LED 1#, underwater LED 2#, underwater LED 3#, underwater LED 4#), underwater wireless optical communication 2#, switch 2#, computer 2#, signal source, and network camera 2#. Among them, four LEDs and underwater wireless optical communication 2# are coplanar and installed on the bracket. The centers of the four LEDs form a rectangle with a length of 32.9 cm and a width of 26.75 cm. Underwater wireless optical communication 2# is located in the center of the rectangle. Network camera 2# can generate network video data to simulate an underwater data terminal; switch 2# simulates the second data fusion module, which can fuse the data in computer 2# and network camera 2# together with the network protocol and send and receive through underwater wireless optical communication 2#; computer 2# can display the video information of network camera 1# in the first simulation device to simulate the data receiving and storage functions of the underwater data terminal; at the same time, computer 2# and computer 1# can respectively simulate FTP client and server to transfer files through FTP protocol. The signal source is used to simulate a light power control device and can generate a 100KHz PWM signal to control the power of four LED lights.

[0130] In the experiment, the central wavelength used by underwater wireless optical communication 1# and underwater wireless optical communication 2# is 405nm, and the spectral width is less than 10nm; the communication transmission angle and receiving field of view are 50°, half-duplex mode is adopted, the protection time slot is set to 5ms during link switching, and the communication link rate is 10Mbps. The central working wavelength of the four LEDs is 470nm, and the spectral width is 30nm.

[0131] Follow these steps to conduct the experiment:

[0132] Step 1: The second simulation device turns on the underwater guidance light array and underwater wireless optical communication 2#, and sends the guidance light and the second communication optical signal into the water;

[0133] Step 2: The first simulation device swims toward the second simulation device from a distance, and uses an underwater camera to shoot the guide light to form a color light pattern, and transmits it to computer 1# in the form of a video stream;

[0134] Step 3: Computer 1# recognizes and processes the light pattern to obtain the brightness information of the guide light, as well as the position information and light brightness information of the second simulation device;

[0135] Step 4: The rotating bracket adjusts its position and orientation according to the orientation information of the second simulation device, so that the underwater wireless optical communication 1# and the underwater wireless optical communication 2# in the first simulation device and the second simulation device are within the communication coverage of each other;

[0136] Step 5: Turn on underwater wireless optical communication 1#, send a first communication optical signal into the water, and establish a bidirectional transmission link with underwater wireless optical communication 2#;

[0137] Step 6: Use computer 1# and computer 2# to access and display the video information in network camera 2# and network camera 1# respectively, and transfer the files in computer 1# to computer 2# via FTP protocol;

[0138] Step 7: Based on the light brightness information obtained in step 3, the brightness of the four LED lights is controlled by the PWM signal generated by the signal source.

[0139] During the experiment, the center of the underwater camera and the guide light array were at the same height, and when the rotating bracket was at an angle of 0°, the center of the guide light array was located at the optical axis of the underwater color camera. The underwater experiment was conducted in a pool with a length of 5m, a width of 1.2m, and a depth of 60mm, and the following results were obtained:

[0140] (1) Once the underwater wireless optical communication 1# and the underwater wireless optical communication 2# are within each other's optical communication coverage, computer 1# can access and display the video in network camera 2#, computer 2# can also access and display the video in network camera 1#, and can transfer files in computer 1# to computer 2#. When the guide light is turned on and the power is at maximum, the video and file transfer services remain smooth. This verifies that the communication equipment under the guide light can work normally and different services do not interfere with each other.

[0141] (2) Under the premise that the two-way wireless optical communication link works normally, keep the guide light incident on the underwater camera, set different distances and shoot the light pattern through the camera, use computer 1# to measure the distance, and the test results are shown in Table 1. It can be seen that when the test distance is between 180cm and 370cm, the absolute value of the error is no more than 1.06. Horizontally rotate the rotating bracket in the first simulation device, shoot the light pattern through computer 1# and calculate the rotation angle, and the results are shown in Table 2. It can be seen from Table 2 that when the test distance is 200cm and 350cm and the rotation angle is between -10° and 10°, the absolute value of the angle error is no more than 1.01. This verifies the effectiveness of the distance and angle information measurement method proposed in the present invention. According to this distance and measurement information, the underwater mobile robot platform can be controlled to adjust its own position and angle.

[0142] Table 1: Test results of the distance when the guide light is incident on the camera

[0143]

[0144]

[0145] Table 2: Angle test results of rotating guide lights at different distances

[0146]

[0147] (3) During the experiment, the maximum brightness information G of the underwater guide light array is preset. max and minimum brightness information G min They are 230 and 180 respectively. The brightness information of different lights can be obtained by analyzing the captured guide light spot through computer 1#, and then the duty cycle of the PWM signal output by the signal source is set according to the method provided by the present invention to adjust the light brightness.

[0148] The above experimental results show that the method provided by the present invention can realize the coordinated work of underwater wireless optical communication and visual guidance measurement. It can realize optical visual guidance measurement when the communication light is turned on, and then control the underwater robot platform to adjust its own position and establish a communication link; it can realize two-way wireless optical communication when the guidance light is turned on, and complete the transmission of two-way data; it can control the brightness of the guidance light according to the brightness of the light spot recognized by vision. The feasibility of the method provided by the present invention is verified.

[0149] The present invention provides an underwater non-contact optical communication system and method, which solves the problem of posture measurement and two-way communication of underwater wireless optical communication cooperation targets by integrating visual guidance measurement technology and underwater wireless optical communication system. The system and method have simple structure, low complexity, easy combination with underwater platform, and convenient promotion and application. Compared with traditional underwater wireless optical communication, the present invention introduces an optical guidance method based on visual measurement into the optical communication system, and a communication terminal is placed on an underwater robot and can move freely. This system can provide real-time relative posture information for the underwater wireless optical communication terminal, and controlling the position and orientation of the robot accordingly helps to establish a stable underwater two-way wireless optical communication link, thereby increasing the stability and reliability of the underwater wireless optical communication link.

[0150] The method provided in the embodiment of the present invention can be applied to an electronic device. Specifically, the electronic device can be: a desktop computer, a portable computer, an intelligent mobile terminal, a server, etc., which is not limited in the embodiment of the present invention.

[0151] Based on the same inventive concept, an embodiment of the present invention further provides an underwater non-contact optical communication system. The underwater non-contact optical communication system includes: a second communication device and a first communication device;

[0152] The second communication device is used to send a guide light and a second communication light signal into the water; obtain the first communication light signal, and complete the brightness adjustment of its own guide light based on the brightness information to obtain a guide adjustment light; under the guide adjustment light, complete non-contact optical communication based on the first communication light signal;

[0153] The first communication device is used to photograph the guide light to obtain a colored light spot pattern and perform pixel-based grayscale processing on the colored light spot pattern, and to determine the guide light spot based on the result of the grayscale processing to obtain the guide light spot; to obtain the brightness information of the guide light based on the result of the grayscale processing and the guide light spot calculation; to determine the orientation information of the second communication device according to the guide light spot and a preset posture estimation algorithm; to adjust its own position and orientation according to the orientation information, so that the first communication device is within the preset energy threshold of the second communication device; when within the preset energy threshold, to receive the second communication light signal and to send the first communication light signal to the second communication device; and to complete the contactless optical communication based on the second communication light signal.

[0154] The embodiment of the present invention further provides a computer-readable storage medium in which a computer program is stored, and when the computer program is executed by a processor, the steps of any of the above-mentioned underwater non-contact optical communication methods are implemented.

[0155] It should be noted that the terms "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention.

[0156] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification.

[0157] Although the present invention is described herein in conjunction with various embodiments, in the process of implementing the claimed invention, those skilled in the art can understand and implement other changes to the disclosed embodiments by viewing the drawings and the disclosed content. In the description of the present invention, the term "comprising" does not exclude other components or steps, "one" or "an" does not exclude multiple situations, and the meaning of "multiple" is two or more, unless otherwise clearly and specifically limited. In addition, certain measures are recorded in different embodiments, but this does not mean that these measures cannot be combined to produce good results.

[0158] The above contents are further detailed descriptions of the present invention in combination with specific preferred embodiments, and it cannot be determined that the specific implementation of the present invention is limited to these descriptions. For ordinary technicians in the technical field to which the present invention belongs, several simple deductions or substitutions can be made without departing from the concept of the present invention, which should be regarded as falling within the protection scope of the present invention.

Claims

1. An underwater non-contact optical communication method, characterized in that: include: The second communication device sends a guide light and a second communication light signal into the water; The first communication device photographs the guide light to obtain a color spot pattern and performs pixel-based grayscale processing on the color spot pattern, and performs a guide spot judgment based on the grayscale processing result to obtain a guide spot; The first communication device calculates the brightness information of the guide light based on the result of the grayscale processing and the guide light spot; determines the orientation information of the second communication device according to the guide light spot and a preset attitude estimation algorithm; The first communication device adjusts its position and orientation according to the position information so that the first communication device is within a preset energy threshold of the second communication device; When the energy is at a preset energy threshold, receiving the second communication optical signal and sending the first communication optical signal to the second communication device; The brightness information is carried in the first communication optical signal; The second communication device obtains the first communication optical signal, and adjusts the brightness of its own guide light based on the brightness information to obtain the guide adjustment light; The second communication device and the first communication device complete non-contact optical communication based on the first communication optical signal and the second communication optical signal under the guide adjustment light; The second communication device is a fixed observation node device, and the first communication device is an operation observation device.

2. The underwater non-contact optical communication method according to claim 1, characterized in that: The step of photographing the guide light to obtain a color spot pattern and performing pixel-based grayscale processing on the color spot pattern, and performing a guide spot judgment based on the grayscale processing result to obtain the guide spot includes: Photographing the guide light to obtain the color spot pattern; Establishing a coordinate system with a preset position as an origin in the light spot pattern, and obtaining an RGB pixel value of each pixel in the light spot pattern; A grayscale image is obtained by calculation based on a preset grayscale calculation formula and the RGB pixel values; Performing Gaussian filtering, binarization, and Hough change detection on the grayscale image in sequence to obtain multiple spot center coordinates and spot radii; The guiding light spot determination process is performed on the multiple light spots based on the center coordinates of the light spots to obtain the guiding light spot.

3. The underwater non-contact optical communication method according to claim 2, characterized in that: The preset grayscale calculation formula is expressed as: g(x,y)=0.299R(x,y)+0.587G(x,y)+0.114B(x,y); Among them, g(x,y) represents the grayscale value of the grayscale image at the coordinate (x,y), x represents the horizontal coordinate of the spot pattern, y represents the vertical coordinate of the spot pattern, R(x,y) represents the pixel value at the coordinate (x,y) under the R channel, G(x,y) represents the pixel value at the coordinate (x,y) under the G channel, and B(x,y) represents the pixel value at the coordinate (x,y) under the B channel.

4. The underwater non-contact optical communication method according to claim 2, characterized in that: When the number of the center coordinates of the light spots is equal to the number of the guiding lights plus 1, the guiding light spot determination process is performed on the multiple light spots based on the center coordinates of the light spots to obtain the guiding light spots, including: S201, calculating the distances from the center coordinates of all the light spots to the preset positions to obtain a plurality of first distances; S202, taking the light spot center coordinate corresponding to the maximum value among the multiple first distances as the initial guidance coordinate, and adding the initial guidance coordinate to a preset guidance set to obtain a current guidance set; taking the light spot center coordinates other than the current guidance set as current coordinates to be processed; S203, calculating the unit vector of the initial guidance coordinate relative to the preset position to obtain a first unit vector; calculating the unit vector of the current coordinate to be processed relative to the initial guidance coordinate to obtain a second unit vector; S204, rotating the first unit vector clockwise, and adding the light spot center coordinates corresponding to the first overlap of the second unit vector with the first unit vector to the current guide set; and taking the light spot center coordinates other than the current guide set as current coordinates to be processed; S205, performing unit vector calculation on the center coordinates of the light spot most recently added in the current guiding set relative to the center coordinates of the light spot most recently added, to obtain a current unit vector; calculating the unit vector between the current coordinate to be processed and the center coordinates of the light spot most recently added in the current guiding set as the current comparison unit vector; S206, rotating the current unit vector clockwise, adding the light spot center coordinates corresponding to the first overlap between the current control unit vector and the current unit vector to the current guide set; and taking the light spot center coordinates other than the current guide set as current coordinates to be processed; S207, looping through steps S205-S206 until the number of the center coordinates of the light spots in the current guiding set is equal to the number of the guiding lights, and taking the center coordinates of the light spots in the current guiding set as the guiding light spots; Wherein, the preset position is the upper left corner of the light spot pattern.

5. The underwater non-contact optical communication method according to claim 2, characterized in that: The calculating and obtaining the brightness information of the guide light based on the result of the grayscale processing and the guide light spot includes: Based on the grayscale image, a grayscale mean within the light spot radius is calculated for each guiding light spot, and the grayscale mean is used as brightness information of the guiding light.

6. The underwater non-contact optical communication method according to claim 1, characterized in that: The determining the position information of the second communication device according to the guide light spot and a preset attitude estimation algorithm includes: Calculate the rotation matrix R and transformation vector t of the second communication device relative to the first communication device according to the guide light spot and the PNP algorithm; Based on the rotation matrix R, the transformation vector t and a preset orientation calculation formula, obtaining orientation information of the second communication device; The azimuth information includes: the distance d of the second communication device relative to the first communication device, the yaw angle θ of the second communication device relative to the first communication device Yaw , the elevation angle θ of the second communication device relative to the first communication device Pitch and the roll angle θ of the second communication device relative to the first communication device Roll .

7. The underwater non-contact optical communication method according to claim 6, characterized in that: The preset position calculation formula is expressed as: θ Pitch =arcsin(-R 31 ); Among them, R mn Represents the upper left m×n submatrix of R, m represents the row of the matrix rotation matrix R, and n represents the column of the matrix rotation matrix R.

8. The underwater non-contact optical communication method according to claim 6, characterized in that: The first communication device adjusts its position and orientation according to the position information so that the first communication device is within a preset energy threshold of the second communication device, including: The first communication device adjusts its own position and orientation according to the orientation information; The distance d of the second communication device relative to the first communication device and the yaw angle θ of the second communication device relative to the first communication device are Yaw , the elevation angle θ of the second communication device relative to the first communication device Pitch and the roll angle θ of the second communication device relative to the first communication device Roll are all less than the preset threshold.

9. An underwater non-contact optical communication system, characterized in that: The underwater non-contact optical communication system comprises: a second communication device and a first communication device; The second communication device is used to send a guide light and a second communication light signal into the water; obtain the first communication light signal, and complete the brightness adjustment of its own guide light based on the brightness information to obtain a guide adjustment light; under the guide adjustment light, complete non-contact optical communication based on the first communication light signal; The first communication device is used to photograph the guide light to obtain a colored light spot pattern and perform pixel-based grayscale processing on the colored light spot pattern, and perform guide light spot judgment based on the result of the grayscale processing to obtain a guide light spot; calculate the brightness information of the guide light based on the result of the grayscale processing and the guide light spot; determine the orientation information of the second communication device according to the guide light spot and a preset posture estimation algorithm; adjust its own position and orientation according to the orientation information, so that the first communication device is within the preset energy threshold of the second communication device; when within the preset energy threshold, receive the second communication light signal and send the first communication light signal to the second communication device; and complete non-contact optical communication based on the second communication light signal.

10. A storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by the processor, the steps of the underwater non-contact optical communication method as described in any one of claims 1 to 8 are executed.

Citation Information

Cited By

  • Underwater wireless optical communication and azimuth measurement integrated system and method

    CN119995721A

  • Underwater wireless optical communication method and system

    CN120811485A