A dynamic positioning management system and method based on visual laser collaboration
Through the dynamic positioning management system of visual laser collaborative use of laser measurement and camera orientation calibration functions, the problem of difficult to determine the latitude and longitude of ships in offshore wind farms is solved, and precise positioning is achieved without AIS to ensure the safety and operational efficiency of the wind farm.
Patent Information
- Application Number
- CN202411001904.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-25
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2044-07-25
AI Technical Summary
Camera in offshore wind farms cannot provide the latitude and longitude data of the ship in real time, making it difficult to determine whether the ship is close to the wind farm, affecting the safety management and operational efficiency of the wind farm.
Using a dynamic positioning management system based on visual laser collaboration, the target ship is aligned by a mobile camera, the distance is measured by laser, and the plane or spherical distance formula is selected according to the distance size to calculate the latitude and longitude of the ship. Combined with historical data and the camera's orientation calibration function, it is determined. Thresholds and calculation errors ensure precise positioning.
The latitude and longitude coordinates of the ship can be obtained without the help of AIS, reduce the pressure of computing resource, reduce the interference of latitude and longitude coordinates at different locations on the analysis of the ship's moving trajectory, and ensure the safe and normal operation of the offshore wind farm.
Smart Images

Figure CN118548876B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of marine vessel positioning, and in particular to a dynamic positioning management system and method based on visual laser collaboration. Background Art
[0002] Offshore wind farms refer to wind farms built on the ocean, which use offshore wind resources to generate electricity. Offshore wind power has many advantages, such as high wind speed, stable wind direction, and less impact on the environment. Through longitude and latitude data, the position of ships can be monitored in real time, their movement trajectory can be tracked, and they can be ensured not to enter sensitive areas of wind farms. If a ship deviates from the scheduled route, the longitude and latitude data can be used to guide the ship back to a safe route and avoid approaching the wind farm. The longitude and latitude data of ships is an important part of wind farm safety management, which helps prevent accidents, improve operational efficiency, and ensure the long-term stable operation of wind farms. However, when the cameras in offshore wind farms identify and capture ships approaching the wind farm, they can only provide pictures, but not the longitude and latitude of the target ship. The cameras in offshore wind farms use lasers to measure the distance between the target ship and the camera, but cannot provide the longitude and latitude of the target ship. Therefore, how to determine the longitude and latitude of ships near offshore wind farms has become an urgent problem to be solved. Summary of the invention
[0003] The purpose of the present invention is to provide a dynamic positioning management system and method based on visual laser collaboration to solve the problems raised in the above background technology.
[0004] In one aspect of the present invention, a dynamic positioning management method based on visual laser collaboration is provided, comprising:
[0005] S11, moving the camera to aim at the target ship, and using laser to measure the distance between the target ship and the camera; if the distance between the target ship and the camera is less than a threshold, proceed to step S12; if the distance between the target ship and the camera is not less than the threshold, proceed to step S13;
[0006] S12, without considering the influence of the distance between two points caused by the spherical surface, the longitude and latitude of the target ship are determined by the distance formula between two points on the plane, and then the process goes to step S14;
[0007] S13, considering the influence of the distance between two points caused by the spherical surface, the longitude and latitude of the target ship are determined by the Haversine formula, and then the process goes to step S14;
[0008] S14, monitors the longitude and latitude changes of the target ship to ensure the safety and normal operation of the offshore wind farm.
[0009] In step S11, the threshold is determined by the following steps:
[0010] The historical data of historical ships in the offshore wind farm are obtained, wherein the historical data include longitude and latitude and the distance r between the historical ship and the camera; based on the longitude and latitude data, the distance between the ship and the camera is calculated by the distance formula between two points on a plane and the Haversine formula respectively, and the absolute value e of the error under the two calculation methods is taken; the absolute value of the error and the distance are fitted, the input is the distance r between the historical ship and the camera, the output is the absolute value e of the error, and a mapping from r to e is obtained: e=f(r), f(r) is differentiated with respect to r, and the first maximum point of the first-order derivative is found, and the distance corresponding to the maximum point is the threshold.
[0011] When the distance between the ship and the camera is small, the influence of the spherical surface can be ignored and the plane distance formula can be used directly for calculation to reduce the pressure on computing resources; when the distance is large, the influence of the spherical surface cannot be ignored; before the threshold, the error increases slowly, and after reaching the threshold, the error increases faster, and the rate of change of the error near the threshold is large, that is, the maximum point of the first-order derivative.
[0012] In step S12, determining the longitude and latitude of the target vessel by using the distance formula between two points on a plane further includes the following steps:
[0013] S31, call the camera's orientation calibration function, call the camera's north-pointing function or manually adjust the camera to point to the north, record the P value of the camera's pan / tilt at this time, and record it as P0; obtain the camera's longitude and latitude information, and record it as (x1, y1), where x1 is longitude and y1 is latitude;
[0014] S32, move the camera, aim at the target ship, and initiate laser ranging to obtain the distance between the camera and the target ship; adjust the horizontal direction of the camera to initiate laser ranging, and when the distance between the camera and the target ship reaches the minimum value When , record the P value of the camera pan / tilt and the time t0 when the distance reaches the minimum value. The P value of the camera pan / tilt at this time is recorded as Adjust the horizontal direction of the camera to initiate laser ranging. When the distance between the camera and the target ship reaches the maximum value When , record the P value of the camera pan / tilt and the time t1 when the distance reaches the maximum value. The P value of the camera pan / tilt at this time is recorded as
[0015] The laser beam hitting different positions of the target ship will bring different measurement results. When the ship is in motion, the edge of the ship is difficult to reflect the exact position of the ship; secondly, the laser hitting different positions of the ship at different times will interfere with the analysis of the ship's motion trajectory compared to hitting the same position of the ship. When the distance reaches the minimum and maximum values, the laser hits the edge of the ship, and only adjusts the horizontal direction, and the vertical angle has no effect, because the positions hit by the laser in different vertical directions are parallel lines, and the P values of the midpoints of the parallel lines are the same.
[0016] S33, let the angle between the line connecting the camera and the target ship and the north direction be θ, When the distance between the camera and the target ship reaches the minimum value, the longitude and latitude of the edge of the target ship is The latitude and longitude of the target ship edge are calculated using the following formula:
[0017]
[0018] S34, when the distance between the camera and the target ship reaches the maximum value, let the longitude and latitude of the edge of the target ship be Repeat step S33 to obtain the longitude and latitude
[0019] S35, let the speed of the target ship be (v x ,v y ), v x is the velocity in the longitude direction, v y is the latitude speed; get the time difference t between t1 and t0; at t0, and Keep unchanged, yes and Make adjustments, for The value after adjusting from t1 to t0 is based on Calculate the time t0
[0020] S36, according to and Calculate the latitude and longitude of the target ship at time t0, and set the camera position, and For A, B and C, first calculate the distance D between points BC. Then calculate the distance between AC Let the midpoint of BC be con, and calculate the distance d between A and concon , Let the P value of the midpoint of BC be P con , According to P con and d con Determine the latitude and longitude (x,y) of the target ship,
[0021]
[0022] is the measurement result at time t1, The measurement result at time t0 needs to be unified to the same time for analysis. First, according to the camera P value at t0, we can get First, according to the camera P value at time t1, we can get According to the speed of the ship, the Converted to time t0 At this time, the three sides of the triangle are known, and the length of the center line and the P value in the direction of the center line can be obtained. The length of the center line is also the distance from the camera. The position of the target ship can be obtained based on the distance and the P value.
[0023] S37, at time t1, and Keep unchanged, yes and Make adjustments, for The value after adjusting from t0 to t1 is based on Calculate the time t1 Execute step S36 to obtain the longitude and latitude of the target vessel at time t1.
[0024] In step S35, the speed of the target vessel is determined by the following steps:
[0025] S41, after time t1, adjust the horizontal direction of the camera to initiate laser ranging. When the distance between the camera and the target ship reaches the minimum value When , record the P value of the camera pan / tilt and the time t2 when the distance reaches the minimum value. The P value of the camera pan / tilt at this time is recorded as Execute step S33 to obtain the latitude and longitude of the edge of the target ship at time t2 according to and Calculate the speed of the target ship,
[0026] S42, after time t2, adjust the horizontal direction of the camera to initiate laser ranging. When the distance between the camera and the target ship reaches the maximum value When t3 is reached, the P value of the camera pan / tilt and the time when the distance reaches the maximum value are recorded. The P value of the camera pan / tilt at this time is recorded as Execute step S33 to obtain the latitude and longitude of the edge of the target ship at time t3 according to and Calculate the speed of the target ship, Take v x1 and v x2 The average value of v x , take v y1 and v y2 The average value of v y ;
[0027] S43, based on the minimum distance between the camera and the target ship at time t2 P value of camera pan / tilt The maximum distance between the camera and the target ship at time t3 and the P value of the camera pan / tilt Steps S33 to S37 are executed to obtain the longitude and latitude of the target ship at time t2 and the longitude and latitude of the target ship at time t3.
[0028] In step S13, the method of determining the longitude and latitude of the target vessel by using the Haversine formula further includes the following steps:
[0029] Execute steps S31 and S32;
[0030] Execute step S33, in which the latitude and longitude of the edge of the target vessel are changed. The calculation formula is and This becomes an expression in radians: Convert x1 and y1 into radians: Solve by the following system of equations:
[0031]
[0032] Execute steps S34 and S35;
[0033] Execute step S36, in which x and y are expressed in radians, The calculation formula for changing the longitude and latitude (x, y) of the target ship is: In triangle ABC, BC is the length between the two edges of the ship, which is a small value, and the effect of the sphere on the distance can be ignored. The distance of AB is the measurement value of the laser, and the distance of AC is calculated by the Haversine formula;
[0034] Execute step S37 to obtain the longitude and latitude of the target vessel at time t1.
[0035] In another aspect of the present invention, a dynamic positioning management system based on visual laser collaboration is provided, including a data acquisition module, a data analysis module and an integrated management module; the output end of the data acquisition module is connected to the input end of the data analysis module, for identifying a target vessel, and measuring the distance between the target vessel and the camera by laser, and sending the distance information to the data analysis module; the output end of the data analysis module is connected to the input end of the integrated management module, and the longitude and latitude of the target vessel are determined based on the distance information between the target vessel and the camera and the longitude and latitude information of the camera; the integrated management module is used to monitor the longitude and latitude changes of the target vessel to ensure the safety and normal operation of the offshore wind farm.
[0036] The data acquisition module also includes: a laser distance measuring unit, an image recognition unit, a timer unit and a data storage unit; the laser distance measuring unit is used to measure the distance between the target ship and the camera, the image recognition unit is in the same direction as the laser distance measuring unit, and when the image recognition unit recognizes the target ship, the laser distance measuring unit starts to measure the distance; the timer unit is used to record the measurement time of the laser distance measuring unit; the data storage unit is used to store the distance between the target ship and the camera and the measurement time. The data acquisition module sends the distance between the target ship and the camera, the time of measuring the minimum distance and the time of measuring the maximum distance to the data analysis module.
[0037] The data analysis module further includes a plane distance calculation unit, a spherical distance calculation unit, a longitude and latitude calculation unit, a speed calculation unit and an analysis unit; the plane distance calculation unit is used to calculate the distance between the camera and the target ship and the edge of the target ship when the spherical effect is ignored; the spherical distance calculation unit is used to calculate the distance between the camera and the target ship and the edge of the target ship when the spherical effect is considered; the longitude and latitude calculation unit is used to determine the edge of the target ship and the longitude and latitude of the target ship; the speed calculation unit is used to determine the speed of the target ship; the analysis unit determines the distance calculation method based on the distance between the camera and the edge of the target ship. The analysis unit determines the distance calculation method according to the distance calculation error when the spherical effect is ignored and when the spherical effect is considered.
[0038] Compared with the prior art, the beneficial effects achieved by the present invention are: without the aid of AIS, the longitude and latitude coordinates of the ship can still be obtained through camera and laser measurement when the ship does not turn on AIS; the longitude and latitude coordinates of the middle position of the ship are obtained, thereby reducing the interference of the longitude and latitude coordinates of different positions of the ship in analyzing the movement trajectory of the ship. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:
[0040] Figure 1 It is a structural schematic diagram of a subway data real-time monitoring system based on multi-data collection according to an embodiment of the present invention;
[0041] Figure 2 It is a geometric relationship diagram of an embodiment of the present invention. DETAILED DESCRIPTION
[0042] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0043] In the embodiments of the present invention, please refer to Figure 1 , provides a dynamic positioning management system based on visual laser collaboration, including: a data acquisition module, a data analysis module and an integrated management module; the output end of the data acquisition module is connected to the input end of the data analysis module, which is used to identify the target ship, and measure the distance between the target ship and the camera by laser, and send the distance information to the data analysis module; the output end of the data analysis module is connected to the input end of the integrated management module, and the longitude and latitude of the target ship are determined based on the distance information between the target ship and the camera and the longitude and latitude information of the camera; the integrated management module is used to monitor the longitude and latitude changes of the target ship to ensure the safety and normal operation of the offshore wind farm.
[0044] The data acquisition module also includes: a laser distance measuring unit, an image recognition unit, a timer unit and a data storage unit; the laser distance measuring unit is used to measure the distance between the target ship and the camera, the image recognition unit is in the same direction as the laser distance measuring unit, and when the image recognition unit recognizes the target ship, the laser distance measuring unit starts to measure the distance; the timer unit is used to record the measurement time of the laser distance measuring unit; the data storage unit is used to store the distance between the target ship and the camera and the measurement time. The data acquisition module sends the distance between the target ship and the camera, the time of measuring the minimum distance and the time of measuring the maximum distance to the data analysis module.
[0045] The data analysis module further includes a plane distance calculation unit, a spherical distance calculation unit, a longitude and latitude calculation unit, a speed calculation unit and an analysis unit; the plane distance calculation unit is used to calculate the distance between the camera and the target ship and the edge of the target ship when the spherical effect is ignored; the spherical distance calculation unit is used to calculate the distance between the camera and the target ship and the edge of the target ship when the spherical effect is considered; the longitude and latitude calculation unit is used to determine the edge of the target ship and the longitude and latitude of the target ship; the speed calculation unit is used to determine the speed of the target ship; the analysis unit determines the distance calculation method based on the distance between the camera and the edge of the target ship. The analysis unit determines the distance calculation method according to the distance calculation error when the spherical effect is ignored and when the spherical effect is considered.
[0046] In an embodiment of the present invention, a dynamic positioning management method based on visual laser collaboration is provided, comprising:
[0047] S11, moving the camera to aim at the target ship, and using laser to measure the distance between the target ship and the camera; if the distance between the target ship and the camera is less than a threshold, proceed to step S12; if the distance between the target ship and the camera is not less than the threshold, proceed to step S13;
[0048] The threshold is determined by the following steps:
[0049] The historical data of historical ships in the offshore wind farm are obtained, wherein the historical data include longitude and latitude and the distance r between the historical ship and the camera; based on the longitude and latitude data, the distance between the ship and the camera is calculated by the distance formula between two points on a plane and the Haversine formula respectively, and the absolute value e of the error under the two calculation methods is taken; the absolute value of the error and the distance are fitted, the input is the distance r between the historical ship and the camera, the output is the absolute value e of the error, and a mapping from r to e is obtained: e=f(r), f(r) is differentiated with respect to r, and the first maximum point of the first-order derivative is found, and the distance corresponding to the maximum point is the threshold.
[0050] S12, without considering the influence of the distance between two points caused by the spherical surface, the longitude and latitude of the target ship are determined by the distance formula between two points on the plane, and then the process goes to step S14;
[0051] Determining the latitude and longitude of the target vessel by the distance formula between two plane points also includes the following steps S31 to S37:
[0052] S31, call the camera's orientation calibration function, call the camera's north-pointing function or manually adjust the camera to point to the north, record the P value of the camera's pan / tilt at this time, and record it as P0; obtain the camera's longitude and latitude information, and record it as (x1, y1), where x1 is longitude and y1 is latitude;
[0053] S32, move the camera, aim at the target ship, and initiate laser ranging to obtain the distance between the camera and the target ship; adjust the horizontal direction of the camera to initiate laser ranging, and when the distance between the camera and the target ship reaches the minimum value When , record the P value of the camera pan / tilt and the time t0 when the distance reaches the minimum value. The P value of the camera pan / tilt at this time is recorded as Adjust the horizontal direction of the camera to initiate laser ranging. When the distance between the camera and the target ship reaches the maximum value When , record the P value of the camera pan / tilt and the time t1 when the distance reaches the maximum value. The P value of the camera pan / tilt at this time is recorded as
[0054] S33, let the angle between the line connecting the camera and the target ship and the north direction be θ, When the distance between the camera and the target ship reaches the minimum value, the longitude and latitude of the edge of the target ship is The latitude and longitude of the target ship edge are calculated using the following formula:
[0055]
[0056] S34, when the distance between the camera and the target ship reaches the maximum value, let the longitude and latitude of the edge of the target ship be Repeat step S33 to obtain the longitude and latitude
[0057] The speed of the target vessel is determined by the following steps S41 to S42:
[0058] S41, after time t1, adjust the horizontal direction of the camera to initiate laser ranging. When the distance between the camera and the target ship reaches the minimum value When , record the P value of the camera pan / tilt and the time t2 when the distance reaches the minimum value. The P value of the camera pan / tilt at this time is recorded as Execute step S33 to obtain the latitude and longitude of the edge of the target ship at time t2 according to and Calculate the speed of the target ship,
[0059] S42, after time t2, adjust the horizontal direction of the camera to initiate laser ranging. When the distance between the camera and the target ship reaches the maximum value When t3 is reached, the P value of the camera pan / tilt and the time when the distance reaches the maximum value are recorded. The P value of the camera pan / tilt at this time is recorded as Execute step S33 to obtain the latitude and longitude of the edge of the target ship at time t3 according to and Calculate the speed of the target ship, Take v x1 and v x2 The average value of v x , take v y1 and v y2 The average value of v y .
[0060] S35, let the speed of the target ship be (v x ,v y ), v x is the velocity in the longitude direction, v y is the latitude speed; get the time difference t between t1 and t0; at t0, and Keep unchanged, yes and Make adjustments, for The value after adjusting from t1 to t0 is based on Calculate the time t0
[0061] S36, according to and Calculate the latitude and longitude of the target ship at time t0, and set the camera position, and For A, B and C, first calculate the distance D between points BC. Then calculate the distance between AC Let the midpoint of BC be con, and calculate the distance d between A and con con , Let the P value of the midpoint of BC be Pcon , According to P con and d con Determine the latitude and longitude (x,y) of the target ship,
[0062]
[0063] S37, at time t1, and Keep unchanged, yes and Make adjustments, for The value after adjusting from t0 to t1 is based on Calculate the time t1 Execute step S36 to obtain the longitude and latitude of the target vessel at time t1.
[0064] Repeat steps S31 to S37 to obtain a longitude and latitude change sequence of the target ship for analyzing the target ship. When considering a spherical surface, the Haversine formula is used to calculate the edge of the target ship and the distance between the target ship and the camera.
[0065] According to the minimum distance between the camera and the target ship at time t2 P value of camera pan / tilt The maximum distance between the camera and the target ship at time t3 and the P value of the camera pan / tilt Steps S33 to S37 are executed to obtain the longitude and latitude of the target ship at time t2 and the longitude and latitude of the target ship at time t3. The speed of the target ship is adjusted according to the subsequent measurement results after time t3 to calculate the longitude and latitude of the target ship at time t2 and the longitude and latitude of the target ship at time t3.
[0066] S13, considering the influence of the distance between two points caused by the spherical surface, the longitude and latitude of the target ship are determined by the Haversine formula, and then the process proceeds to step S14; specifically, the following steps are included:
[0067] Execute steps S31 and S32;
[0068] Execute step S33, in which the latitude and longitude of the edge of the target vessel are changed. The calculation formula is and This becomes an expression in radians: Convert x1 and y1 into radians: Solve by the following system of equations:
[0069] Execute steps S34 and S35;
[0070] Execute step S36, in which x and y are expressed in radians, The calculation formula for changing the longitude and latitude (x, y) of the target ship is:
[0071] Execute step S37 to obtain the longitude and latitude of the target vessel at time t1.
[0072] S14, monitors the longitude and latitude changes of the target ship to ensure the safety and normal operation of the offshore wind farm.
[0073] Take Hikvision cameras as an example:
[0074] 1. Set the PTZ P value when the camera is facing due north. Steps:
[0075] Step 1: Call the azimuth calibration function of the Hikvision camera;
[0076] Step 2: Call the Hikvision camera's function of pointing to the true north or manually adjust the camera to point to the true north, and record the P value of the camera's PTZ at this time; the value range of P is a floating point number between [0,360], and the accurate value can be obtained by calling the manufacturer's SDK;
[0077] 2. Get the latitude and longitude of the camera:
[0078] Step 1: The result value is already known during offshore construction; if the offshore camera is equipped with a GPS system, it can also be read from the GPS;
[0079] 3. Get the distance of the target ship and the P value of the camera pan / tilt at this time:
[0080] Step 1: Turn on the laser ranging assistance "+";
[0081] Step 2: Move the camera, aim at the target ship, and obtain the P value of the PTZ at this time;
[0082] Step 3: Initiate laser ranging to obtain the distance between the camera and the target ship;
[0083] 4. According to the above parameters, a geometric relationship diagram can be constructed;
[0084] 5. List the system of equations and solve them.
[0085] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.
[0086] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. A dynamic positioning management method based on visual laser collaboration, characterized in that: The following steps are involved: S11, moving the camera to aim at the target ship, and using laser to measure the distance between the target ship and the camera; If the distance between the target ship and the camera is less than the threshold, the process proceeds to step S12; if the distance between the target ship and the camera is not less than the threshold, the process proceeds to step S13; S12, without considering the influence of the distance between two points caused by the spherical surface, the longitude and latitude of the target ship are determined by the distance formula between two points on the plane, and then the process goes to step S14; In step S12, determining the longitude and latitude of the target vessel by using the distance formula between two points on a plane further includes the following steps: S31, call the camera's orientation calibration function, call the camera's north-pointing function or manually adjust the camera to point to the north, record the P value of the camera's pan / tilt at this time, record it as P0; obtain the camera's latitude and longitude information, record it as (x 1, y1), where x1 is longitude and y1 is latitude; S32, move the camera, aim at the target ship, and initiate laser ranging to obtain the distance between the camera and the target ship; adjust the horizontal direction of the camera to initiate laser ranging, and when the distance between the camera and the target ship reaches the minimum value When , record the P value of the camera pan / tilt and the time t0 when the distance reaches the minimum value. The P value of the camera pan / tilt at this time is recorded as Adjust the horizontal direction of the camera to initiate laser ranging. When the distance between the camera and the target ship reaches the maximum value When , record the P value of the camera pan / tilt and the time t1 when the distance reaches the maximum value. The P value of the camera pan / tilt at this time is recorded as S33, let the angle between the line connecting the camera and the target ship and the north direction be θ, When the distance between the camera and the target ship reaches the minimum value, the longitude and latitude of the edge of the target ship is The latitude and longitude of the target ship edge are calculated using the following formula: S34, when the distance between the camera and the target ship reaches the maximum value, let the longitude and latitude of the edge of the target ship be Repeat step S33 to obtain the longitude and latitude S35, let the speed of the target ship be (v x , v y ), v x is the velocity in the longitude direction, v y is the latitude speed; get the time difference t between t1 and t0; at t0, and Keep unchanged, yes and Make adjustments, for The value after adjusting from t1 to t0 is based on Calculate the time t0 S36, according to and Calculate the latitude and longitude of the target ship at time t0, and set the camera position, and For A, B and C, first calculate the distance D between points BC. Then calculate the distance between AC Let the midpoint of BC be con, and calculate the distance d between A and con con , Let the P value of the midpoint of BC be P con , According to P con and d con Determine the latitude and longitude (x, y) of the target ship, S37, at time t1, and Keep unchanged, yes and Make adjustments, for The value after adjusting from t0 to t1 is based on Calculate the time t1 Execute step S36 to obtain the longitude and latitude of the target vessel at time t1; In step S35, the speed of the target vessel is determined by the following steps: S41, after time t1, adjust the horizontal direction of the camera to initiate laser ranging. When the distance between the camera and the target ship reaches the minimum value When , record the P value of the camera pan / tilt and the time t2 when the distance reaches the minimum value. The P value of the camera pan / tilt at this time is recorded as Execute step S33 to obtain the latitude and longitude of the edge of the target ship at time t2 according to and Calculate the speed of the target ship, S42, after time t2, adjust the horizontal direction of the camera to initiate laser ranging. When the distance between the camera and the target ship reaches the maximum value When t3 is reached, the P value of the camera pan / tilt and the time when the distance reaches the maximum value are recorded. The P value of the camera pan / tilt at this time is recorded as Execute step S33 to obtain the latitude and longitude of the edge of the target ship at time t3 according to and Calculate the speed of the target ship, Take v x1 and v x2 The average value of v x , take v y1 and v y2 The average value of v y ; S43, based on the minimum distance between the camera and the target ship at time t2 P value of camera pan / tilt The maximum distance between the camera and the target ship at time t3 and the P value of the camera pan / tilt Execute steps S33 to S37 to obtain the longitude and latitude of the target ship at time t2 and the longitude and latitude of the target ship at time t3; S13, considering the influence of the distance between two points caused by the spherical surface, the longitude and latitude of the target ship are determined by the Haversine formula, and then the process goes to step S14; S14, monitors the longitude and latitude changes of the target ship to ensure the safety and normal operation of the offshore wind farm.
2. According to claim 1, a dynamic positioning management method based on visual laser collaboration is characterized in that: In step S11, the threshold is determined by the following steps: The historical data of historical ships in the offshore wind farm are obtained, wherein the historical data include longitude and latitude and the distance r between the historical ship and the camera; based on the longitude and latitude data, the distance between the ship and the camera is calculated by the distance formula between two points on a plane and the Haversine formula respectively, and the absolute value e of the error under the two calculation methods is taken; the absolute value of the error and the distance are fitted, the input is the distance r between the historical ship and the camera, the output is the absolute value e of the error, and a mapping from r to e is obtained: e=f(r), f(r) is differentiated with respect to r, and the first maximum point of the first-order derivative is found, and the distance corresponding to the maximum point is the threshold.
3. According to the method of dynamic positioning management based on visual laser collaboration in claim 1, it is characterized in that: In step S13, the method of determining the longitude and latitude of the target vessel by using the Haversine formula further includes the following steps: Execute steps S31 and S32; Execute step S33, in which the latitude and longitude of the edge of the target vessel are changed. The calculation formula is and This becomes an expression in radians: Convert x1 and y1 into radians: Solve by the following system of equations: Execute steps S34 and S35; Execute step S36, in which x and y are expressed in radians, The calculation formula for changing the longitude and latitude (x, y) of the target ship is: Execute step S37 to obtain the longitude and latitude of the target vessel at time t1.
4. A dynamic positioning management system based on visual laser collaboration, implementing a dynamic positioning management method based on visual laser collaboration as described in any one of claims 1-3, characterized in that: It includes a data acquisition module, a data analysis module and an integrated management module; the output end of the data acquisition module is connected to the input end of the data analysis module, and is used to identify the target ship, and measure the distance between the target ship and the camera by laser, and send the distance information to the data analysis module; the output end of the data analysis module is connected to the input end of the integrated management module, and the longitude and latitude of the target ship are determined based on the distance information between the target ship and the camera and the longitude and latitude information of the camera; The integrated management module is used to monitor the longitude and latitude changes of the target ship to ensure the safety and normal operation of the offshore wind farm.
5. A dynamic positioning management system based on visual laser collaboration according to claim 4, characterized in that: The data acquisition module also includes: a laser ranging unit, an image recognition unit, a timer unit and a data storage unit; the laser ranging unit is used to measure the distance between the target ship and the camera, the image recognition unit is consistent with the direction of the laser ranging unit, and when the image recognition unit recognizes the target ship, the laser ranging unit starts to measure the distance; the timer unit is used to record the measurement time of the laser ranging unit; the data storage unit is used to store the distance between the target ship and the camera and the measurement time.
6. A dynamic positioning management system based on visual laser collaboration according to claim 5, characterized in that: The data acquisition module sends the distance between the target ship and the camera, the time of measuring the minimum distance, and the time of measuring the maximum distance to the data analysis module.
7. According to claim 5, a dynamic positioning management system based on visual laser collaboration is characterized in that: The data analysis module further comprises a plane distance calculation unit, a spherical distance calculation unit, a latitude and longitude calculation unit, a speed calculation unit and an analysis unit; the plane distance calculation unit is used to calculate the distance between the camera and the target vessel and the edge of the target vessel when ignoring the influence of the spherical surface; The spherical distance calculation unit is used to calculate the distance between the camera and the target vessel and the edge of the target vessel while considering the influence of the spherical surface; The latitude and longitude calculation unit is used to determine the edge of the target ship and the longitude and latitude of the target ship; The speed calculation unit is used to determine the speed of the target ship; the analysis unit determines the distance calculation method based on the distance between the camera and the edge of the target ship.
8. The dynamic positioning management system based on visual laser collaboration according to claim 7 is characterized in that: The analysis unit determines the distance calculation method according to the distance calculation error when the spherical surface effect is ignored and when the spherical surface effect is considered.
