Radar photoelectric linkage tracking system, target tracking method and equipment

By acquiring and predicting the target monitoring parameters in the radar photoelectric linkage system, the photoelectric equipment is controlled for real-time tracking, solving the tracking problems caused by target follow-up and intersection, and achieving stable tracking and accuracy of the target in the photoelectric image.

CN119064916AInactive Publication Date: 2024-12-03HAINAN HAILAN HUANYU MARINE INFORMATION TECH CO LTD

Patent Information

Application Number
CN202411206692.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-30
Publication Date
2024-12-03
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In the existing radar photoelectric linkage tracking system, the target follows the jitter, non-smoothing, does not center, or even runs out of the photoelectric image, and it cannot continue to track when the intersection between the target occurs.

Method used

By obtaining the current monitoring parameters of the monitoring target, determining the initial photoelectric horizontal angle and pitch angle, predicting the target position parameters, and controlling the photoelectric equipment for real-time tracking, ensuring that the target is centered in the photoelectric image, and using the intersection duration and relative pixel speed to deal with the intersection phenomenon , continuous tracking of achieving goals.

Benefits of technology

The stable tracking of the target in the radar photoelectric linkage tracking system is achieved to prevent jitter and loss, improve tracking accuracy, ensure that the target is in the middle of the photoelectric image, and continues to track under intersection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119064916A_ABST
    Figure CN119064916A_ABST
Patent Text Reader

Abstract

The invention provides a radar photoelectric linkage tracking system, a target tracking method and equipment, and relates to the technical field of computer information processing. The method comprises the following steps: acquiring a current monitoring parameter of a monitoring target; according to the current monitoring parameters, determining predicted position parameters corresponding to the monitoring target when the photoelectric equipment rotates to the current position of the monitoring target; according to the predicted position parameter, controlling photoelectric equipment to track the monitoring target in real time to obtain a photoelectric image of the position of the monitoring target; detecting a ship in the photoelectric image in real time, and determining a monitoring target; and according to the image pixel position of the monitoring target, the photoelectric device is controlled to adjust the monitoring target to the central position of the photoelectric image, and real-time monitoring and tracking are carried out. According to the scheme, it is ensured that the target is in the middle of the photoelectric image, and when the target is lost due to intersection between the targets, normal tracking of the target can still be kept.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of computer information processing, and in particular to a radar optoelectronic linkage tracking system, a target tracking method and a device. Background Art

[0002] Optoelectronic video surveillance and radar linkage have been widely used in areas such as shore-based offshore waters, ports, and waterways. The use of optoelectronic cameras to monitor ships in the waters has become one of the necessary security measures. Combined with radar or AIS (Automatic Identification System) data, optoelectronics can intuitively display the real-time dynamics of ship targets, confirm whether the ship is in violation of regulations or in distress, and provide decision-making assistance for command and dispatch. At present, most strategies for optoelectronic linkage are to obtain target parameter information such as longitude and latitude, distance, azimuth, heading, speed, length, etc. through radar or AIS or the fusion of the two, and then calculate the optoelectronic horizontal angle, pitch angle and field of view angle through the above parameters and send them to the optoelectronic system; but due to the low frequency of radar or AIS target data transmission or the error of the fusion data of the two, and the optoelectronic command reception frequency is much higher than the former, it will cause obvious jitter in the image when the optoelectronic follow-up, and the jitter cannot be reduced when the target data jumps significantly or even errors occur. In addition, when the target intersects and causes the target to be lost, the optoelectronic cannot obtain data for tracking. Summary of the invention

[0003] The technical problem to be solved by the present invention is to provide a radar optoelectronic linkage tracking system, a target tracking method and a device, which solves the problem that the target jitters, is not smooth, is not centered, or even runs out of the optoelectronic image during the use of the existing radar optoelectronic linkage tracking system.

[0004] In order to solve the above technical problems, the technical solution of the present invention is as follows:

[0005] An embodiment of the present invention provides a target tracking method, which is applied to a radar optoelectronic linkage tracking system. The method includes:

[0006] Get the current monitoring parameters of the monitoring target;

[0007] Determining an initial photoelectric horizontal angle and an initial photoelectric elevation angle of the monitored target according to the current monitoring parameters;

[0008] Determine the predicted position parameters of the monitoring target when the optoelectronic device rotates to the current position of the monitoring target according to the current monitoring parameters, the initial optoelectronic horizontal angle and the initial optoelectronic pitch angle of the monitoring target;

[0009] According to the predicted position parameters of the monitoring target, controlling the optoelectronic device to track the monitoring target in real time to obtain an optoelectronic image of the location of the monitoring target, wherein the optoelectronic image includes at least one vessel;

[0010] Performing real-time detection on the vessel in the photoelectric image and determining the monitoring target;

[0011] According to the image pixel position of the monitoring target in the photoelectric image, the photoelectric device is controlled to adjust the monitoring target to the center position of the photoelectric image for real-time monitoring and tracking.

[0012] Optionally, the predicted position parameters corresponding to the monitoring target when the photoelectric device rotates to the current position of the monitoring target are determined according to the current monitoring parameters, the initial photoelectric horizontal angle, and the initial photoelectric pitch angle of the monitoring target, including:

[0013] Acquire current parameters of the optoelectronic device, wherein the current parameters include: a current horizontal angle, a current pitch angle, a current horizontal movement speed, and a current vertical movement speed of the optoelectronic device;

[0014] Determining the required rotational horizontal angle and rotational pitch angle of the optoelectronic device according to the initial optoelectronic horizontal angle, the initial optoelectronic pitch angle and the current parameters;

[0015] Determine the rotation time required for the optoelectronic device to rotate to the current position of the monitoring target according to the horizontal rotation angle and the pitch rotation angle;

[0016] The predicted position parameters of the monitoring target are determined according to the current monitoring parameters and the rotation time.

[0017] Optionally, determining the rotation time required for the photoelectric device to rotate to the current position of the monitoring target according to the horizontal rotation angle and the pitch rotation angle includes:

[0018] According to the horizontal rotation angle and the current horizontal movement speed of the optoelectronic device, the horizontal transit time TimePan is determined by the formula TimePan=abs(CameraCurPan-CameraPan) / CameraspeedPan;

[0019] Among them, CameraCurPan-CameraPan is the horizontal angle of rotation, CameraCurPan is the current horizontal angle of the photoelectric device, CameraPan is the initial photoelectric horizontal angle of the monitored target, and CameraspeedPan is the current horizontal movement speed of the photoelectric device;

[0020] According to the rotation pitch angle and the current vertical movement speed of the optoelectronic device, the vertical transit time TimeTilt is determined by the formula TimeTilt=abs(CameraCurTilt-CameraTilt) / CameraspeedTilt;

[0021] Among them, CameraCurTilt-CameraTilt is the rotation pitch angle, CameraCurTilt is the current pitch angle of the photoelectric device, CameraTilt is the initial photoelectric pitch angle of the monitored target, and CameraspeedTilt is the current vertical movement speed of the photoelectric device;

[0022] The vertical transport time and the horizontal transport time are compared and the maximum value is output as the rotation time.

[0023] Optionally, determining the predicted position parameters of the monitoring target according to the current monitoring parameters and the rotation time includes:

[0024] According to the current monitoring parameters and the rotation time, the latitude data PosLat in the predicted position parameter is determined by the formula PosLat=CurLat+cos(course)*speed*(Time+CurTime-TargetTime);

[0025] According to the current monitoring parameters and the rotation time, the longitude data PosLon in the predicted position parameter is determined by the formula PosLon=CurLon+sin(course)*speed / CurLat;

[0026] Among them, CurLon is the current longitude of the monitoring target, CurLat is the current latitude of the monitoring target, course is the current heading of the monitoring target, speed is the current speed of the monitoring target, Time is the rotation time, CurTime is the current real time when predicting the position parameters, and TargetTime is the parameter acquisition time.

[0027] Optionally, the target tracking method further includes:

[0028] When there are multiple ships in the photoelectric image, basic photoelectric parameters of all ships are obtained, wherein the basic photoelectric parameters include: the upper left corner X coordinate, the upper left corner Y coordinate, the width and the height of the ship in the photoelectric image;

[0029] determining, based on the basic optoelectronic parameters, an intersecting vessel that can intersect with the monitoring target;

[0030] Determine the intersection queue and the corresponding intersection duration corresponding to each intersection vessel according to the position relationship between the monitoring target and the intersection vessel in the photoelectric image;

[0031] The monitoring target is monitored and tracked in real time according to the intersection duration.

[0032] Optionally, determining the intersecting vessels that can intersect with the monitoring target according to the basic optoelectronic parameters, including:

[0033] When the distance between a vessel other than the monitoring target and the monitoring target satisfies TiX + TiW / 2 > TTX and TiX + TiW / 2 < TTX + TTW, and / or

[0034] TiY + TiH / 2 > TTY and TiY + TiH / 2 < TTY + TTH, then the current vessel is determined as an intersecting vessel;

[0035] where Ti is a vessel other than the monitoring target, TiX is the upper left corner X coordinate of Ti in the optoelectronic image, TiY is the upper left corner Y coordinate of Ti in the optoelectronic image, TiW is the width of Ti in the optoelectronic image, TiH is the height of Ti in the optoelectronic image, TT is the monitoring target, TTX is the upper left corner X coordinate of the monitoring target in the optoelectronic image, TTY is the upper left corner Y coordinate of the monitoring target in the optoelectronic image, TTW is the width of the monitoring target in the optoelectronic image, and TTH is the height of the monitoring target in the optoelectronic image.

[0036] Optionally, determining the intersection duration corresponding to each intersecting vessel according to the positional relationship and basic optoelectronic parameters between the monitoring target and the intersecting vessel in the optoelectronic diagram, including:

[0037] Determining the pixel distance difference Pix between each intersecting vessel and the monitoring target at different time periods according to the positional relationship and basic optoelectronic parameters between the monitoring target and the intersecting vessel in the optoelectronic diagram n and the corresponding timestamp Time n ;

[0038] According to the pixel distance difference Pix between each intersecting vessel and the monitoring target at different time periods n and the corresponding timestamp Time n , through the formula RSpeed = (Pix1 - Pix n ) / (Time1 - Time n ), determining the relative pixel speed between each intersecting vessel and the monitoring target;

[0039] According to the relative pixel speed, through the formula UnionTime = (TTX + TTW - TTLeftX) / RSpeed, determining the intersection duration corresponding to each intersecting vessel;

[0040] where RSpeed is the relative pixel speed between the current intersecting vessel and the monitoring target, UnionTime is the intersection duration corresponding to the current intersecting vessel and the monitoring target, Pix1 is the first pixel distance difference between the current intersecting vessel and the monitoring target at the first time, Pixn is the nth pixel distance difference between the current intersecting ship and the monitoring target at the nth time, Time1 is the timestamp corresponding to the first pixel distance difference, and Time n is the timestamp corresponding to the nth pixel distance difference, n is the number of pixel distance differences obtained, TTLeftX is the upper left corner X coordinate of the current intersecting ship in the photoelectric image, TTX is the upper left corner X coordinate of the monitoring target in the photoelectric image, and TTW is the width of the monitoring target in the photoelectric image.

[0041] Optionally, performing real-time monitoring and tracking on the monitoring target according to the intersection duration includes:

[0042] Determine the intersection movement direction and intersection movement speed of the optoelectronic device when the monitoring target intersects with the intersecting vessel;

[0043] When the monitoring target intersects with the intersecting vessel, the optoelectronic device performs real-time monitoring and tracking of the monitoring target according to the intersecting motion direction and the intersecting motion speed during the duration of the intersecting;

[0044] When the intersection is completed, the optoelectronic device is controlled to adjust the monitoring target to the center position of the optoelectronic image according to the image pixel position of the monitoring target in the optoelectronic image, and real-time monitoring and tracking is performed.

[0045] The embodiment of the present invention further provides a radar optoelectronic linkage tracking system, comprising:

[0046] An acquisition module is used to obtain the current monitoring parameters of the monitoring target;

[0047] The target real-time prediction module is used to determine the initial photoelectric horizontal angle and the initial photoelectric pitch angle of the monitoring target according to the current monitoring parameters; and determine the predicted position parameters corresponding to the monitoring target when the photoelectric device rotates to the current position of the monitoring target according to the current monitoring parameters, the initial photoelectric horizontal angle and the initial photoelectric pitch angle of the monitoring target;

[0048] A sensor data tracking module, used to control the optoelectronic device to track the monitored target in real time according to the predicted position parameters of the monitored target, and obtain an optoelectronic image of the location of the monitored target, wherein the optoelectronic image includes at least one vessel;

[0049] The image detection and tracking module is used to detect the ship in the photoelectric image in real time and determine the monitoring target; according to the image pixel position of the monitoring target in the photoelectric image, the photoelectric device is controlled to adjust the monitoring target to the center position of the photoelectric image for real-time monitoring and tracking.

[0050] An embodiment of the present invention further provides a computing device, comprising: a processor and a memory storing a computer program, wherein the computer program executes the method described above when executed by the processor.

[0051] The above solution of the present invention includes at least the following beneficial effects:

[0052] The target tracking method of the present invention obtains the current monitoring parameters of the monitoring target; determines the initial photoelectric horizontal angle and initial photoelectric pitch angle of the monitoring target according to the current monitoring parameters; determines the predicted position parameters corresponding to the monitoring target when the photoelectric device rotates to the current position of the monitoring target according to the current monitoring parameters, the initial photoelectric horizontal angle and the initial photoelectric pitch angle of the monitoring target; controls the photoelectric device to track the monitoring target in real time according to the predicted position parameters of the monitoring target, and obtains the photoelectric image of the location of the monitoring target, wherein the photoelectric image includes at least one ship; performs real-time detection on the ship in the photoelectric image and determines the monitoring target; controls the photoelectric device to adjust the monitoring target to the center position of the photoelectric image according to the image pixel position of the monitoring target in the photoelectric image, and performs real-time monitoring and tracking. The radar photoelectric linkage tracking system ensures that the target is in the middle of the photoelectric image while ensuring that the tracking target is correct, and prevents the target from shaking, not smooth, not centered or even running out of the photoelectric image. At the same time, when the target is lost due to the intersection between the targets, the target can still be tracked normally, thereby improving the accuracy of target tracking. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 It is a flow chart of the target tracking method of the present invention;

[0054] Figure 2 It is a schematic diagram of the optoelectronic image of the optoelectronic device when the target tracking method of the present invention is applied to the radar optoelectronic linkage tracking system;

[0055] Figure 3 It is a module schematic diagram of the radar optoelectronic linkage tracking system of the present invention;

[0056] Figure 4 It is a schematic diagram of a specific tracking process of the radar optoelectronic linkage tracking system of the present invention. DETAILED DESCRIPTION

[0057] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0058] like Figure 1 and Figure 2 As shown, an embodiment of the present invention provides a target tracking method, which is applied to a radar optoelectronic linkage tracking system, and the method includes:

[0059] Step 11, obtaining the current monitoring parameters of the monitoring target;

[0060] Step 12, determining an initial photoelectric horizontal angle and an initial photoelectric pitch angle of the monitored target according to the current monitoring parameters;

[0061] Step 13, determining the predicted position parameters corresponding to the monitoring target when the photoelectric device rotates to the current position of the monitoring target according to the current monitoring parameters, the initial photoelectric horizontal angle and the initial photoelectric pitch angle of the monitoring target;

[0062] Step 14, according to the predicted position parameters of the monitoring target, controlling the optoelectronic device to track the monitoring target in real time, and obtaining an optoelectronic image of the location of the monitoring target, wherein the optoelectronic image includes at least one vessel;

[0063] Step 15, performing real-time detection on the vessel in the photoelectric image and determining the monitoring target;

[0064] Step 16, according to the image pixel position of the monitoring target in the photoelectric image, control the photoelectric device to adjust the monitoring target to the center position of the photoelectric image to perform real-time monitoring and tracking.

[0065] In this embodiment, step 11 is specifically to obtain the current monitoring parameters of the monitoring target in real time through the sensors of the radar optoelectronic linkage tracking system; the current monitoring parameters include: parameter acquisition time, current longitude, current latitude, current speed, current heading and longitude and latitude of the optoelectronic device and altitude of the monitoring target; the sensor can be radar and AIS (Automatic Identification System), that is, the current monitoring parameters can be radar data, AIS data or a fusion data of the two; step 12 is specifically to calculate the current optoelectronic horizontal angle and current optoelectronic pitch angle of the monitoring target by monitoring the current longitude, current latitude, current speed, current heading and longitude and latitude of the optoelectronic device and altitude.

[0066] In this embodiment, step 14 specifically determines the predicted horizontal angle and the predicted pitch angle according to the predicted position parameters of the monitoring target; according to the predicted horizontal angle and the predicted pitch angle, controls the optoelectronic device to track the monitoring target in real time to obtain an optoelectronic image of the location of the monitoring target, wherein the optoelectronic image includes at least one ship.

[0067] In this embodiment, step 15 specifically includes real-time detection of the vessel in the photoelectric image through a CNN (convolutional) neural network model, and performing vessel detection according to the Hungarian algorithm and outputting the vessel ID, the pixel position and the pixel size of the vessel in real time; if a single vessel appears in the photoelectric image, the vessel is used as the monitoring target; if multiple vessels appear in the photoelectric image, the vessel whose pixel is closest to the center of the image is selected as the monitoring target according to the principle of optimization;

[0068] In this embodiment, step 16 specifically calculates the position difference between the image pixel position of the current monitoring target in the photoelectric image and the image center pixel, and converts it into an angle difference in combination with the field of view angle, and inputs the angle difference into a PID (proportional-integral-differential controller) module, sends the target tracking horizontal speed and the target tracking vertical speed output by the PID module to the photoelectric device, switches the photoelectric device to move in speed mode (i.e., controls the photoelectric device to move with the target tracking horizontal speed and the target tracking vertical speed output by the PID module), so that the current monitoring target is near the center of the image, and continuously repeats step 16, so that the monitoring target is always in the center of the photoelectric image. The target tracking method of the present invention solves the problem that the target following motion jitters, is not smooth, is not centered, or even runs out of the image during the use of the existing radar photoelectric linkage tracking system. The radar photoelectric linkage tracking system ensures that the target is in the middle of the photoelectric image while ensuring that the tracking target is correct, and prevents the target following motion jitters, is not smooth, is not centered, or even runs out of the photoelectric image.

[0069] In an optional embodiment of the present invention, step 13 may include:

[0070] Step 131, obtaining current parameters of the optoelectronic device, wherein the current parameters include: a current horizontal angle, a current pitch angle, a current horizontal movement speed, and a current vertical movement speed of the optoelectronic device;

[0071] Step 132, determining the required rotational horizontal angle and rotational pitch angle of the optoelectronic device according to the initial optoelectronic horizontal angle, the initial optoelectronic pitch angle and the current parameters;

[0072] Step 133, determining the rotation time required for the photoelectric device to rotate to the current position of the monitoring target according to the horizontal rotation angle and the pitch rotation angle;

[0073] Step 134, determining the predicted position parameters of the monitoring target according to the current monitoring parameters and the rotation time.

[0074] In this embodiment, the design of determining the predicted position parameters of the monitored target can effectively solve the problem that the target following motion is jittery and not smooth due to the long target data update cycle of sensors such as radar or AIS, which leads to a large difference with the photoelectric instruction response frequency, and it takes a certain amount of time for the photoelectric to rotate to the specified position. Therefore, it is necessary to predict the position of the target data of sensors such as radar or AIS to ensure that the target appears in the photoelectric image after the photoelectric reaches the specified position, thereby improving the accuracy of target tracking.

[0075] In an optional embodiment of the present invention, step 133 may include:

[0076] According to the horizontal rotation angle and the current horizontal movement speed of the optoelectronic device, the horizontal transit time TimePan is determined by the formula TimePan=abs(CameraCurPan-CameraPan) / CameraspeedPan;

[0077] Among them, CameraCurPan-CameraPan is the horizontal angle of rotation, CameraCurPan is the current horizontal angle of the photoelectric device, CameraPan is the initial photoelectric horizontal angle of the monitored target, and CameraspeedPan is the current horizontal movement speed of the photoelectric device;

[0078] According to the rotation pitch angle and the current vertical movement speed of the optoelectronic device, the vertical transit time TimeTilt is determined by the formula TimeTilt=abs(CameraCurTilt-CameraTilt) / CameraspeedTilt;

[0079] Among them, CameraCurTilt-CameraTilt is the rotation pitch angle, CameraCurTilt is the current pitch angle of the photoelectric device, CameraTilt is the initial photoelectric pitch angle of the monitored target, CameraspeedTilt is the current vertical movement speed of the photoelectric device; abs is the absolute value;

[0080] The vertical transport time and the horizontal transport time are compared and the maximum value is output as the rotation time.

[0081] In an optional embodiment of the present invention, step 134 may include:

[0082] According to the current monitoring parameters and the rotation time, the latitude data PosLat in the predicted position parameter is determined by the formula PosLat=CurLat+cos(course)*speed*(Time+CurTime-TargetTime);

[0083] According to the current monitoring parameters and rotation time, the longitude data PosLon in the predicted position parameters is determined by the formula PosLon = CurLon + sin(course) * speed / CurLat;

[0084] where CurLon is the current longitude of the monitoring target, CurLat is the current latitude of the monitoring target, course is the current heading of the monitoring target, speed is the current speed of the monitoring target, Time is the rotation time, CurTime is the current real-time time when the predicted position parameters are obtained, and TargetTime is the parameter acquisition time.

[0085] In an optional embodiment of the present invention, the target tracking method further includes:

[0086] Step 17, when there are multiple vessels in the optoelectronic image, obtain the basic optoelectronic parameters of all vessels, where the basic optoelectronic parameters include: the upper left corner X coordinate, the upper left corner Y coordinate, the width, and the height of the vessel in the optoelectronic image;

[0087] Step 18, determine the intersecting vessels that can intersect with the monitoring target according to the basic optoelectronic parameters;

[0088] Step 19, determine the corresponding intersection queue and the corresponding intersection duration of each intersecting vessel according to the positional relationship between the monitoring target and the intersecting vessels in the optoelectronic image;

[0089] Step 20, perform real-time monitoring and tracking on the monitoring target according to the intersection duration.

[0090] In this embodiment, through the design of determining the intersecting vessels and the intersection duration, the problem that the existing radar optoelectronic linkage tracking system cannot continue to track when the target vessel intersects with other vessel targets and the target is lost during use can be effectively solved. It realizes that when the target is lost due to the intersection between targets, the normal tracking of the target can still be maintained.

[0091] In an optional embodiment of the present invention, step 18 may include:

[0092] When the vessel other than the monitoring target and the monitoring target satisfy TiX + TiW / 2 > TTX and TiX + TiW / 2 < TTX + TTW, and / or

[0093] TiY + TiH / 2 > TTY and TiY + TiH / 2 < TTY + TTH, then the current vessel is determined as the intersecting vessel;

[0094] Wherein, Ti is a vessel other than the monitoring target, TiX is the upper left corner X coordinate of Ti in the optoelectronic image, TiY is the upper left corner Y coordinate of Ti in the optoelectronic image, TiW is the width of Ti in the optoelectronic image, TiH is the height of Ti in the optoelectronic image, TT is the monitoring target, TTX is the upper left corner X coordinate of the monitoring target in the optoelectronic image, TTY is the upper left corner Y coordinate of the monitoring target in the optoelectronic image, TTW is the width of the monitoring target in the optoelectronic image, and TTH is the height of the monitoring target in the optoelectronic image.

[0095] In an optional embodiment of the present invention, according to the positional relationship between the monitoring target and the intersecting vessels in the optoelectronic image, determining the intersection queue corresponding to each intersecting vessel includes:

[0096] According to the positional relationship between the monitoring target and the intersecting vessels in the optoelectronic image, classifying the intersecting vessels in the first preset area as the first intersection queue, wherein the first preset area is located on the left side of the monitoring target;

[0097] According to the positional relationship between the monitoring target and the intersecting vessels in the optoelectronic image, classifying the intersecting vessels in the second preset area as the second intersection queue, wherein the second preset area is located on the right side of the monitoring target;

[0098] According to the positional relationship between the monitoring target and the intersecting vessels in the optoelectronic image, classifying the intersecting vessels in the third preset area as the third intersection queue, wherein the third preset area is located above the monitoring target;

[0099] According to the positional relationship between the monitoring target and the intersecting vessels in the optoelectronic image, classifying the intersecting vessels in the fourth preset area as the fourth intersection queue, wherein the fourth preset area is located below the monitoring target.

[0100] As Figure 2 shown, in this embodiment, specifically, when for a vessel Ti other than the monitoring target and the monitoring target TT, TiY + TiH / 2 > TTY and TiY + TiH / 2 < TTY + TTH, then this target is determined as an upcoming intersection target, and at the same time, according to the relative left - right position between Ti and TT, calculate the pixel distance difference between the two and the corresponding timestamp and save them into the corresponding left (first intersection queue) or right (second intersection queue) intersection queue; Figure 2 If Ti in is on the left side of TT and belongs to the first preset area, then it is classified into the first intersection queue; similarly, if TiX + TiW / 2 > TTX and TiX + TiW / 2 < TTX + TTW, then this target is determined as an upcoming intersection target, and at the same time, according to the relative up - down position between Ti and TT, calculate the pixel distance difference between the two and the corresponding timestamp and save them into the corresponding upper (third intersection queue) or lower (fourth intersection queue) intersection queue.

[0101] In an optional embodiment of the present invention, determining the intersection duration corresponding to each intersection vessel according to the positional relationship between the monitoring target and the intersection vessel in the photoelectric map and the basic photoelectric parameters includes:

[0102] According to the positional relationship between the monitoring target and the intersecting ship in the photoelectric image and the basic photoelectric parameters, the pixel distance difference Pix between each intersecting ship and the monitoring target in different time periods is determined. n And the corresponding timestamp Time n ;

[0103] According to the pixel distance difference Pix between each intersecting ship and the monitoring target in different time periods n And the corresponding timestamp Time n , through the formula RSpeed ​​= (Pix1-Pix n ) / (Time1-Time n ), determine the relative pixel speed of each intersecting vessel and the monitoring target;

[0104] According to the relative pixel speed, the intersection duration corresponding to each intersection vessel is determined by the formula UnionTime=(TTX+TTW-TTLeftX) / RSpeed;

[0105] Among them, RSpeed ​​is the relative pixel speed between the current intersecting ship and the monitoring target, UnionTime is the corresponding intersection duration of the current intersecting ship and the monitoring target, Pix1 is the first pixel distance difference between the current intersecting ship and the monitoring target at the first time, Pix n is the nth pixel distance difference between the current intersecting ship and the monitoring target at the nth time, Time1 is the timestamp corresponding to the first pixel distance difference, and Time n is the timestamp corresponding to the nth pixel distance difference, n is the number of pixel distance differences obtained, TTLeftX is the upper left corner X coordinate of the current intersecting ship in the photoelectric image, TTX is the upper left corner X coordinate of the monitoring target in the photoelectric image, and TTW is the width of the monitoring target in the photoelectric image.

[0106] In this embodiment, according to the positional relationship between the monitoring target and the intersecting vessel in the photoelectric image and the basic photoelectric parameters, the pixel distance difference Pix between each intersecting vessel and the monitoring target in different time periods is determined. n And the corresponding timestamp Time n , and the pixel distance difference Pix n And the corresponding timestamp Time nAccording to the position relationship, it is stored in the corresponding intersection queue; where different time periods refer to each different time period before the intersection, specifically, the pixel distance difference between the intersection ship and the monitoring target is calculated every preset time (which can be once every 1 minute), and the calculated pixel distance difference and the corresponding timestamp of the calculation are stored in the corresponding intersection queue, and the calculation is continued until the last pixel distance difference Pix n The value of is less than or equal to 5, then the corresponding timestamp is Time n , indicating that the monitoring target and the intersecting vessel are about to intersect. At this time, the intersection duration is calculated based on the statistical data in the intersection queue. For example, Figure 2 As shown in the figure, when the first time it is detected that the intersecting ship is located on the left side of the target (that is, when the intersecting ship enters the first preset area for the first time), the pixel distance difference at the first time is Pix1, and the corresponding timestamp is Time1; the pixel distance difference is calculated once every preset time and the corresponding timestamp is obtained and recorded in the first intersecting queue. When the pixel difference decreases to less than or equal to 5 over time (because the monitored target and the intersecting ship are constantly approaching each other, the pixel difference before the intersection will gradually decrease over time), the corresponding timestamp is Time n , at this time, the data in the first intersection queue is {(Pix1, Time1), (Pix2, Time2), ..., (Pix n ,Time n )}.

[0107] In an optional embodiment of the present invention, step 20 may include:

[0108] Determine, according to the intersection duration, the intersection movement direction and intersection movement speed of the optoelectronic device when the monitoring target and the intersection vessel intersect;

[0109] When the monitoring target intersects with the intersecting vessel, the photoelectric device performs real-time monitoring and tracking of the monitoring target for the duration of the intersection according to the intersection movement direction and intersection movement speed;

[0110] When the intersection is completed, the optoelectronic device is controlled to adjust the monitoring target to the center position of the optoelectronic image according to the image pixel position of the monitoring target in the optoelectronic image, and real-time monitoring and tracking is performed.

[0111] In this embodiment, according to the intersection duration, when the monitoring target and the intersection ship intersect, the intersection movement direction and the intersection movement speed of the photoelectric device are determined. Specifically, when the monitoring target and the intersection ship intersect, the intersection movement direction and the intersection movement speed of the photoelectric device movement are calculated by the PID (proportional-integral-differential controller) module (that is, the last output result of PID before the monitoring target and the intersection ship intersect is the intersection movement direction and the intersection movement speed); after the intersection of the two is completed, the PID module continues to track them in real time.

[0112] In an optional embodiment of the present invention, the target tracking method further includes:

[0113] Step 21, obtaining the photoelectric real-time position parameters of the photoelectric device adjusted according to the predicted position parameters;

[0114] Step 22, compare the photoelectric real-time position parameters with the predicted position parameters. When the comparison results for a preset number of consecutive times are greater than a preset error range, it is determined that there is an error in the photoelectric image, and the current monitoring parameters of the monitoring target are re-acquired, and the monitoring target is re-determined based on the current monitoring parameters, and the monitoring target is tracked in real time.

[0115] In this embodiment, the real-time monitoring and correction module in the radar optoelectronic linkage tracking system can be started. The module obtains the data (predicted position data) of the target prediction module in the radar optoelectronic linkage tracking system in real time and monitors the current optoelectronic position. If the current optoelectronic position and the position output by the target prediction module are compared for five consecutive times and the results are all greater than the preset error range, it is determined that an error has occurred in the optoelectronic image tracking. At this time, the image tracking is stopped and the sensor tracking mode is switched back to ensure that the target is tracked correctly, and then the process of steps 11 to 16 is continued.

[0116] The target tracking method of the present invention first obtains the current monitoring parameters of the monitoring target in real time through the sensor of the radar optoelectronic linkage tracking system, ensures that the tracking target is in the image screen and the tracking is correct according to the current monitoring parameters, then ensures that the ship is in the center of the image in combination with the optoelectronic image, and judges in real time whether the optoelectronic image target has an intersection phenomenon, and performs navigation and speed maintenance processing based on the PID module on the intersection phenomenon, which can solve the problem that the target following movement is jittery, not smooth, not centered, or even runs out of the image during the use of the existing radar optoelectronic linkage tracking system, and cannot continue to track when the target is lost due to intersection between the targets. The radar optoelectronic linkage tracking system ensures that the target is in the middle of the optoelectronic image while ensuring that the tracking target is correct, prevents the target following movement from jittering, not smooth, not centered, or even running out of the image, and when the target is lost due to intersection between the targets, the target can still be tracked normally, and through the design of step 21 and step 22, the current tracking target can be corrected in real time, and problems can be found in time when problems occur, and re-tracking can be achieved in conjunction with sensors and optoelectronic devices.

[0117] like Figure 3 As shown, an embodiment of the present invention provides a radar optoelectronic linkage tracking system 30, comprising:

[0118] An acquisition module 31 is used to acquire current monitoring parameters of a monitoring target;

[0119] The target real-time prediction module 32 is used to determine the initial photoelectric horizontal angle and the initial photoelectric pitch angle of the monitoring target according to the current monitoring parameters; and determine the predicted position parameters corresponding to the monitoring target when the photoelectric device rotates to the current position of the monitoring target according to the current monitoring parameters, the initial photoelectric horizontal angle and the initial photoelectric pitch angle of the monitoring target;

[0120] The sensor data tracking module 33 is used to control the optoelectronic device to track the monitored target in real time according to the predicted position parameters of the monitored target, and obtain an optoelectronic image of the location of the monitored target, wherein the optoelectronic image includes at least one vessel;

[0121] The image detection and tracking module 34 is used to detect the ship in the photoelectric image in real time and determine the monitoring target; according to the image pixel position of the monitoring target in the photoelectric image, control the photoelectric device to adjust the monitoring target to the center position of the photoelectric image for real-time monitoring and tracking.

[0122] Optionally, the predicted position parameters corresponding to the monitoring target when the photoelectric device rotates to the current position of the monitoring target are determined according to the current monitoring parameters, the initial photoelectric horizontal angle, and the initial photoelectric pitch angle of the monitoring target, including:

[0123] Acquire current parameters of the optoelectronic device, wherein the current parameters include: a current horizontal angle, a current pitch angle, a current horizontal movement speed, and a current vertical movement speed of the optoelectronic device;

[0124] Determining the required rotational horizontal angle and rotational pitch angle of the optoelectronic device according to the initial optoelectronic horizontal angle, the initial optoelectronic pitch angle and the current parameters;

[0125] Determine the rotation time required for the optoelectronic device to rotate to the current position of the monitoring target according to the horizontal rotation angle and the pitch rotation angle;

[0126] The predicted position parameters of the monitoring target are determined according to the current monitoring parameters and the rotation time.

[0127] Optionally, determining the rotation time required for the photoelectric device to rotate to the current position of the monitoring target according to the horizontal rotation angle and the pitch rotation angle includes:

[0128] According to the horizontal rotation angle and the current horizontal movement speed of the optoelectronic device, the horizontal transit time TimePan is determined by the formula TimePan=(CameraCurPan-CameraPan) / CameraspeedPan;

[0129] Among them, CameraCurPan-CameraPan is the horizontal angle of rotation, CameraCurPan is the current horizontal angle of the photoelectric device, CameraPan is the initial photoelectric horizontal angle of the monitored target, and CameraspeedPan is the current horizontal movement speed of the photoelectric device;

[0130] According to the pitch angle and the current vertical movement speed of the optoelectronic device, the vertical transit time TimeTilt is determined by the formula TimeTilt=(CameraCurTilt-CameraTilt) / CameraspeedTilt;

[0131] Among them, CameraCurTilt-CameraTilt is the rotation pitch angle, CameraCurTilt is the current pitch angle of the photoelectric device, CameraTilt is the initial photoelectric pitch angle of the monitored target, and CameraspeedTilt is the current vertical movement speed of the photoelectric device;

[0132] The vertical transport time and the horizontal transport time are compared and the maximum value is output as the rotation time.

[0133] Optionally, determining the predicted position parameters of the monitoring target according to the current monitoring parameters and the rotation time includes:

[0134] According to the current monitoring parameters and rotation time, the latitude data PosLat in the predicted position parameters is determined through the formula PosLat = CurLat + cos(course) * speed * (Time + CurTime - TargetTime);

[0135] According to the current monitoring parameters and rotation time, the longitude data PosLon in the predicted position parameters is determined through the formula PosLon = CurLon + sin(course) * speed / CurLat;

[0136] Wherein, CurLon is the current longitude of the monitoring target, CurLat is the current latitude of the monitoring target, course is the current heading of the monitoring target, speed is the current speed of the monitoring target, Time is the rotation time, CurTime is the current real-time time when the predicted position parameters are obtained, and TargetTime is the parameter acquisition time.

[0137] Optionally, the radar-optoelectronic linkage tracking system further includes:

[0138] When there are multiple vessels in the optoelectronic image, the basic optoelectronic parameters of all vessels are obtained, and the basic optoelectronic parameters include: the upper left X coordinate, the upper left Y coordinate, the width, and the height of the vessel in the optoelectronic image;

[0139] According to the basic optoelectronic parameters, the intersecting vessels that can intersect with the monitoring target are determined;

[0140] According to the positional relationship between the monitoring target and the intersecting vessels in the optoelectronic image, the corresponding intersection queue and the corresponding intersection duration of each intersecting vessel are determined;

[0141] According to the intersection duration, real-time monitoring and tracking of the monitoring target are performed.

[0142] Optionally, determining the intersecting vessels that can intersect with the monitoring target according to the basic optoelectronic parameters includes:

[0143] When the distance between the vessel other than the monitoring target and the monitoring target satisfies TiX + TiW / 2 > TTX and TiX + TiW / 2 < TTX + TTW, and / or

[0144] TiY + TiH / 2 > TTY and TiY + TiH / 2 < TTY + TTH, then the current vessel is determined as the intersecting vessel;

[0145] Wherein, Ti is a ship other than the monitoring target, TiX is the X coordinate of the upper left corner of Ti in the photoelectric image, TiY is the Y coordinate of the upper left corner of Ti in the photoelectric image, TiW is the width of Ti in the photoelectric image, TiH is the height of Ti in the photoelectric image, TT is the monitoring target, TTX is the X coordinate of the upper left corner of the monitoring target in the photoelectric image, TTY is the Y coordinate of the upper left corner of the monitoring target in the photoelectric image, TTW is the width of the monitoring target in the photoelectric image, and TTH is the height of the monitoring target in the photoelectric image.

[0146] Optionally, determining the intersection duration corresponding to each intersection vessel according to the positional relationship between the monitoring target and the intersection vessel in the photoelectric map and basic photoelectric parameters includes:

[0147] According to the positional relationship between the monitoring target and the intersecting ship in the photoelectric image and the basic photoelectric parameters, the pixel distance difference Pix between each intersecting ship and the monitoring target in different time periods is determined. n And the corresponding timestamp Time n ;

[0148] According to the pixel distance difference Pix between each intersecting ship and the monitoring target in different time periods n And the corresponding timestamp Time n , through the formula RSpeed ​​= (Pix1-Pix n ) / (Time1-Time n ), determine the relative pixel speed of each intersecting vessel and the monitoring target;

[0149] According to the relative pixel speed, the intersection duration corresponding to each intersection vessel is determined by the formula UnionTime=(TTX+TTW-TTLeftX) / RSpeed;

[0150] Among them, RSpeed ​​is the relative pixel speed between the current intersecting ship and the monitoring target, UnionTime is the corresponding intersection duration of the current intersecting ship and the monitoring target, Pix1 is the first pixel distance difference between the current intersecting ship and the monitoring target at the first time, Pix n is the nth pixel distance difference between the current intersecting ship and the monitoring target at the nth time, Time1 is the timestamp corresponding to the first pixel distance difference, and Time n is the timestamp corresponding to the nth pixel distance difference, n is the number of pixel distance differences obtained, TTLeftX is the upper left corner X coordinate of the current intersecting ship in the photoelectric image, TTX is the upper left corner X coordinate of the monitoring target in the photoelectric image, and TTW is the width of the monitoring target in the photoelectric image.

[0151] Optionally, performing real-time monitoring and tracking of the monitoring target according to the intersection duration includes: determining, according to the intersection duration, an intersection movement direction and an intersection movement speed of the photoelectric device when the monitoring target and the intersection vessel intersect;

[0152] When the monitoring target intersects with the intersecting vessel, the photoelectric device performs real-time monitoring and tracking of the monitoring target for the duration of the intersection according to the intersection movement direction and intersection movement speed;

[0153] When the intersection is completed, the optoelectronic device is controlled to adjust the monitoring target to the center position of the optoelectronic image according to the image pixel position of the monitoring target in the optoelectronic image, and real-time monitoring and tracking is performed.

[0154] Optionally, the radar optoelectronic linkage tracking system further includes:

[0155] The real-time monitoring correction module is used to obtain the photoelectric real-time position parameters of the photoelectric device after adjustment according to the predicted position parameters; compare the photoelectric real-time position parameters with the predicted position parameters. When the comparison results for a preset number of consecutive times are all greater than a preset error range, it is determined that there is an error in the photoelectric image, and the current monitoring parameters of the monitoring target are then re-acquired, and the monitoring target is re-determined based on the current monitoring parameters, and the monitoring target is tracked in real time.

[0156] like Figure 4 As shown, the specific execution process of the target tracking method described in the present invention applied to the radar optoelectronic linkage tracking system is as follows: first, a monitoring target is selected, that is, the current monitoring parameters of the monitoring target are obtained, and the parameters are input into the target real-time prediction module, and the target real-time prediction module determines the predicted position parameters, and then the sensor data tracking module is started, and the optoelectronic device is controlled by the sensor data tracking module to track the monitoring target in real time and obtain the optoelectronic image; then the image detection and tracking module 34 is started, the ship in the optoelectronic image is detected in real time, and the monitoring target is determined according to the preset rules; then the optoelectronic device is controlled by the PID module to adjust the monitoring target to the center position of the optoelectronic image. Place it; then determine whether there is an intersecting ship that intersects with the monitoring target in the current photoelectric image. If not, continue to monitor and track through the PID module. If there is an intersecting ship, determine the duration of the intersection, and then use the intersection speed and intersection direction to track when intersecting, to ensure that the photoelectric equipment continues to move while maintaining navigation and speed, and continue to monitor and track through the PID module after the intersection; then start the real-time monitoring and correction module to detect in real time whether the predicted position parameters and the photoelectric real-time position parameters are within the preset range. When the data is not within the preset range for a preset number of consecutive times, stop image tracking and switch back to the sensor tracking mode. After ensuring that the target is tracked correctly, restart tracking.

[0157] The radar optoelectronic linkage tracking system of the present invention adopts a sensor data tracking mode combined with an optoelectronic image tracking mode to ensure that the target is in the middle of the optoelectronic image while ensuring that the target is tracked correctly, thereby solving the problem of target jitter, unevenness, non-centering, and even running out of the image. In addition, when targets intersect and cause the target to be lost, the present invention can still continue to maintain normal target tracking. At the same time, through the design of a real-time monitoring and correction module, when errors occur in optoelectronic device tracking, sensor data can be used in time to correct them.

[0158] It should be noted that the system is a device corresponding to the above-mentioned method, and all implementation methods in the above-mentioned method embodiments are applicable to the embodiments of the system and can achieve the same technical effects.

[0159] The embodiment of the present invention further provides a computing device, comprising: a processor, a memory storing a computer program, wherein when the computer program is executed by the processor, the method described above is executed. All implementations in the above method embodiment are applicable to this embodiment and can achieve the same technical effect.

[0160] The embodiment of the present invention further provides a computer-readable storage medium, including instructions, which, when executed on a computer, enable the computer to execute the method described above. All implementations in the above method embodiment are applicable to this embodiment and can achieve the same technical effect.

[0161] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0162] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0163] In the embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0164] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0165] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0166] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, ROM, RAM, magnetic disks, or optical disks.

[0167] In addition, it should be noted that in the apparatus and method of the present invention, it is obvious that each component or each step can be decomposed and / or recombined. These decompositions and / or recombinations should be regarded as equivalent schemes of the present invention. Moreover, the steps of performing the above-mentioned series of processing can naturally be performed in chronological order according to the order of description, but it is not necessary to perform them in chronological order, and some steps can be performed in parallel or independently of each other. For those of ordinary skill in the art, it is understood that all or any steps or components of the method and apparatus of the present invention can be implemented in any computing device (including processors, storage media, etc.) or a network of computing devices in hardware, firmware, software or a combination thereof, which can be achieved by those of ordinary skill in the art using their basic programming skills after reading the description of the present invention.

[0168] Therefore, the purpose of the present invention can also be achieved by running a program or a group of programs on any computing device. The computing device can be a well-known general device. Therefore, the purpose of the present invention can also be achieved by simply providing a program product containing a program code that implements the method or device. That is to say, such a program product also constitutes the present invention, and the storage medium storing such a program product also constitutes the present invention. Obviously, the storage medium can be any well-known storage medium or any storage medium developed in the future. It should also be pointed out that in the device and method of the present invention, it is obvious that each component or each step can be decomposed and / or recombined. These decompositions and / or recombinations should be regarded as equivalent schemes of the present invention. In addition, the steps of performing the above-mentioned series of processing can naturally be performed in chronological order according to the order of description, but it is not necessary to perform them in chronological order. Some steps can be performed in parallel or independently of each other.

[0169] The above is a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A target tracking method, characterized in that: Applied to a radar optoelectronic linkage tracking system, the method comprises: Get the current monitoring parameters of the monitoring target; Determining an initial photoelectric horizontal angle and an initial photoelectric elevation angle of the monitored target according to the current monitoring parameters; Determine the predicted position parameters of the monitoring target when the optoelectronic device rotates to the current position of the monitoring target according to the current monitoring parameters, the initial optoelectronic horizontal angle and the initial optoelectronic pitch angle of the monitoring target; According to the predicted position parameters of the monitoring target, controlling the optoelectronic device to track the monitoring target in real time to obtain an optoelectronic image of the location of the monitoring target, wherein the optoelectronic image includes at least one vessel; Performing real-time detection on the vessel in the photoelectric image and determining the monitoring target; According to the image pixel position of the monitoring target in the photoelectric image, the photoelectric device is controlled to adjust the monitoring target to the center position of the photoelectric image for real-time monitoring and tracking.

2. The target tracking method according to claim 1, characterized in that: According to the current monitoring parameters, initial photoelectric horizontal angle and initial photoelectric pitch angle of the monitoring target, the predicted position parameters corresponding to the monitoring target when the photoelectric device rotates to the current position of the monitoring target are determined, including: Acquire current parameters of the optoelectronic device, wherein the current parameters include: a current horizontal angle, a current pitch angle, a current horizontal movement speed, and a current vertical movement speed of the optoelectronic device; Determining the required rotational horizontal angle and rotational pitch angle of the optoelectronic device according to the initial optoelectronic horizontal angle, the initial optoelectronic pitch angle and the current parameters; Determine the rotation time required for the optoelectronic device to rotate to the current position of the monitoring target according to the horizontal rotation angle and the pitch rotation angle; The predicted position parameters of the monitoring target are determined according to the current monitoring parameters and the rotation time.

3. The target tracking method according to claim 2, characterized in that: According to the horizontal rotation angle and the pitch rotation angle, the rotation time required for the photoelectric device to rotate to the current position of the monitoring target is determined, including: According to the horizontal rotation angle and the current horizontal movement speed of the optoelectronic device, the horizontal transit time TimePan is determined by the formula TimePan=abs(CameraCurPan-CameraPan) / CameraspeedPan; Among them, CameraCurPan-CameraPan is the horizontal angle of rotation, CameraCurPan is the current horizontal angle of the photoelectric device, CameraPan is the initial photoelectric horizontal angle of the monitored target, and CameraspeedPan is the current horizontal movement speed of the photoelectric device; According to the rotation pitch angle and the current vertical movement speed of the optoelectronic device, the vertical transit time TimeTilt is determined by the formula TimeTilt=abs(CameraCurTilt-CameraTilt) / CameraspeedTilt; Among them, CameraCurTilt-CameraTilt is the rotation pitch angle, CameraCurTilt is the current pitch angle of the photoelectric device, CameraTilt is the initial photoelectric pitch angle of the monitored target, and CameraspeedTilt is the current vertical movement speed of the photoelectric device; Compare the vertical transfer time and the horizontal transfer time, and output the maximum value as the rotation time.

4. The target tracking method according to claim 2, characterized in that: Determine the predicted position parameters of the monitoring target according to the current monitoring parameters and the rotation time, including: According to the current monitoring parameters and the rotation time, determine the latitude data PosLat in the predicted position parameters through the formula PosLat = CurLat + cos(course) * speed * (Time + CurTime - TargetTime); According to the current monitoring parameters and the rotation time, determine the longitude data PosLon in the predicted position parameters through the formula PosLon = CurLon + sin(course) * speed / CurLat; Wherein, CurLon is the current longitude of the monitoring target, CurLat is the current latitude of the monitoring target, course is the current heading of the monitoring target, speed is the current speed of the monitoring target, Time is the rotation time, CurTime is the current real-time time when the predicted position parameters are obtained, and TargetTime is the parameter acquisition time.

5. The target tracking method according to claim 1, characterized in that: It also includes: When there are multiple ships in the optoelectronic image, obtain the basic optoelectronic parameters of all ships, and the basic optoelectronic parameters include: the upper left corner X coordinate, the upper left corner Y coordinate, the width and the height of the ship in the optoelectronic image; Determine the intersecting ships that can intersect with the monitoring target according to the basic optoelectronic parameters; Determine the corresponding intersection queue and the corresponding intersection duration of each intersecting ship according to the position relationship between the monitoring target and the intersecting ship in the optoelectronic image; Perform real-time monitoring and tracking on the monitoring target according to the intersection duration.

6. The target tracking method according to claim 5, characterized in that: Determine the intersecting ships that can intersect with the monitoring target according to the basic optoelectronic parameters, including: When the ship other than the monitoring target and the monitoring target satisfy TiX + TiW / 2 > TTX and TiX + TiW / 2 < TTX + TTW, and / or TiY + TiH / 2 > TTY and TiY + TiH / 2 < TTY + TTH, then the current ship is determined as the intersecting ship; Wherein, Ti is the ship other than the monitoring target, TiX is the upper left corner X coordinate of Ti in the optoelectronic image, TiY is the upper left corner Y coordinate of Ti in the optoelectronic image, TiW is the width of Ti in the optoelectronic image, TiH is the height of Ti in the optoelectronic image, TT is the monitoring target, TTX is the upper left corner X coordinate of the monitoring target in the optoelectronic image, TTY is the upper left corner Y coordinate of the monitoring target in the optoelectronic image, TTW is the width of the monitoring target in the optoelectronic image, and TTH is the height of the monitoring target in the optoelectronic image.

7. The target tracking method according to claim 5, characterized in that: Determine the corresponding intersection duration of each intersecting ship according to the position relationship between the monitoring target and the intersecting ship in the optoelectronic image and the basic optoelectronic parameters, including: According to the positional relationship between the monitoring target and the intersecting ship in the photoelectric image and the basic photoelectric parameters, the pixel distance difference Pix between each intersecting ship and the monitoring target in different time periods is determined. n And the corresponding timestamp Time n ; According to the pixel distance difference Pix between each intersecting ship and the monitoring target in different time periods n And the corresponding timestamp Time n , through the formula RSpeed ​​= (Pix1-Pix n ) / (Time1-Time n ), determine the relative pixel speed of each intersecting vessel and the monitoring target; Determine the corresponding intersection duration of each intersecting ship through the formula UnionTime = (TTX + TTW - TTLeftX) / RSpeed according to the relative pixel speed; Among them, RSpeed ​​is the relative pixel speed between the current intersecting ship and the monitoring target, UnionTime is the corresponding intersection duration of the current intersecting ship and the monitoring target, Pix1 is the first pixel distance difference between the current intersecting ship and the monitoring target at the first time, Pix n is the nth pixel distance difference between the current intersecting ship and the monitoring target at the nth time, Time1 is the timestamp corresponding to the first pixel distance difference, and Time n is the timestamp corresponding to the nth pixel distance difference, n is the number of pixel distance differences obtained, TTLeftX is the upper left corner X coordinate of the current intersecting ship in the photoelectric image, TTX is the upper left corner X coordinate of the monitoring target in the photoelectric image, and TTW is the width of the monitoring target in the photoelectric image.

8. The target tracking method according to claim 5, characterized in that: According to the intersection duration, real-time monitoring and tracking of the monitoring target is performed, including: Determine the intersection movement direction and intersection movement speed of the optoelectronic device when the monitoring target intersects with the intersecting vessel; When the monitoring target intersects with the intersecting vessel, the optoelectronic device performs real-time monitoring and tracking of the monitoring target according to the intersecting motion direction and the intersecting motion speed during the duration of the intersecting; When the intersection is completed, the optoelectronic device is controlled to adjust the monitoring target to the center position of the optoelectronic image according to the image pixel position of the monitoring target in the optoelectronic image, and real-time monitoring and tracking is performed.

9. A radar optoelectronic linkage tracking system, characterized in that: include: An acquisition module is used to obtain the current monitoring parameters of the monitoring target; The target real-time prediction module is used to determine the initial photoelectric horizontal angle and the initial photoelectric pitch angle of the monitoring target according to the current monitoring parameters; and determine the predicted position parameters corresponding to the monitoring target when the photoelectric device rotates to the current position of the monitoring target according to the current monitoring parameters, the initial photoelectric horizontal angle and the initial photoelectric pitch angle of the monitoring target; A sensor data tracking module, used to control the optoelectronic device to track the monitored target in real time according to the predicted position parameters of the monitored target, and obtain an optoelectronic image of the location of the monitored target, wherein the optoelectronic image includes at least one vessel; The image detection and tracking module is used to detect the ship in the photoelectric image in real time and determine the monitoring target; according to the image pixel position of the monitoring target in the photoelectric image, the photoelectric device is controlled to adjust the monitoring target to the center position of the photoelectric image for real-time monitoring and tracking.

10. A computing device, characterized in that: include: A processor and a memory storing a computer program, wherein when the computer program is executed by the processor, the method according to any one of claims 1 to 8 is performed.

Citation Information

Patent Citations

  • Tracking device and method for solving multiple-target meeting dodging

    CN101833771A

  • Method, system and device for shooting moving object based on table, and storage medium

    CN113724338A

  • Photoelectric target tracking system method based on radar and AIS fusion

    CN117347991A

  • System and method for monitoring vessel traffic information

    US20170356996A1

Cited By

  • Target detection method and system based on radar prior guidance

    CN120894539A

  • Target positioning method based on radar photoelectric linkage guidance

    CN121432409A