Photoelectric pod target locking system based on general segmentation

Abstract

The invention relates to the technical field of target positioning, in particular to a photoelectric pod target locking system based on universal segmentation. Comprising an unmanned aerial vehicle assembly, a signal base station and a ground control center, and the unmanned aerial vehicle assembly comprises an unmanned aerial vehicle, a flight control module, a photoelectric pod module and a wireless transmission module; the signal base station is responsible for receiving a video stream transmitted by the unmanned aerial vehicle and transmitting the video stream to the ground control center in real time, the ground control center displays an image captured by the unmanned aerial vehicle in real time, an operator observes the current environment through a graphical interface and selects and tracks a target, and the flight control module controls the unmanned aerial vehicle. The photoelectric pod module provides real-time video streams and supports remote monitoring and decision making, and the wireless transmission module transmits unmanned aerial vehicle data to a ground control center in real time and supports remote control instruction issuing, so that target tracking precision and real-time performance in various scenes can be improved, and adaptability and universality of the system are enhanced.

Description

Technical Field

[0001] The present invention relates to the technical field of target positioning, and in particular to an optoelectronic pod target locking system based on universal segmentation. Background Art

[0002] The optoelectronic pod is an all-weather electronic reconnaissance device that integrates high-precision measuring equipment such as visible light cameras, infrared thermal imagers, and laser rangefinders. It is used to perform aerial reconnaissance, target aiming, tracking, and positioning, and is widely used in aviation platforms such as drones.

[0003] The existing optoelectronic pod system mainly relies on learning to detect targets, and then manually selects the targets to be tracked based on the detection results.

[0004] However, existing image processing methods have low target recognition accuracy in complex environments and are easily affected by noise and interference, resulting in misidentification and missed recognition, which leads to long manual target selection and confirmation time and cannot meet the real-time tracking requirements of fast-moving targets. Summary of the Invention

[0005] The purpose of the present invention is to provide an optoelectronic pod target locking system based on universal segmentation, aiming to solve the technical problems that existing image processing methods have low target recognition accuracy in complex environments, are easily affected by noise and interference, and may cause misidentification and missed recognition, resulting in long manual target selection and confirmation time, and cannot meet the real-time tracking requirements of fast-moving targets.

[0006] To achieve the above-mentioned purpose, the present invention adopts an optoelectronic pod target locking system based on universal segmentation, which includes an unmanned aerial vehicle component, a signal base station and a ground control center, wherein the unmanned aerial vehicle component is connected to the signal base station, and the ground control center is connected to the signal base station;

[0007] The UAV assembly includes a UAV, a flight control module, an optoelectronic pod module and a wireless transmission module, wherein the wireless transmission module is connected to the signal base station, the flight control module is connected to the UAV, and the UAV, the flight control module and the optoelectronic pod module are respectively connected to the wireless transmission module;

[0008] The signal base station is responsible for receiving the video stream transmitted by the drone and transmitting the video stream to the ground control center in real time;

[0009] The ground control center is used to display the images captured by the UAV in real time, and the operator observes the current environment through a graphical interface and selects and tracks targets;

[0010] The UAV is used as a mobile platform for the system to perform reconnaissance missions;

[0011] The flight control module is used to control the attitude, altitude, speed and path planning of the UAV;

[0012] The optoelectronic pod module is used to provide real-time video streaming to support remote monitoring and decision-making;

[0013] The wireless transmission module is used to transmit the drone data to the ground control center in real time, supporting the issuance of remote control instructions.

[0014] Wherein, the optoelectronic pod module includes a sensor unit and an image processing unit, the image processing module is connected to the wireless transmission module, and the sensor unit is connected to the graphics processing unit;

[0015] The sensor unit is used to capture real-time video stream;

[0016] The image processing unit is used to process the video image.

[0017] Wherein, the image processing unit includes a pre-processing sub-unit and a general segmentation sub-unit, and the pre-processing sub-unit and the general segmentation sub-unit are respectively connected to the wireless transmission module;

[0018] The pre-processing sub-unit is used to perform denoising and enhancement processing on the collected image;

[0019] The general segmentation subunit is used to perform pixel-level segmentation on the object on which the mouse is hovering, distinguish the target from the background, and accurately extract the target features.

[0020] Wherein, the sensor unit includes a visible light camera subunit and an infrared thermal imaging subunit, and the visible light camera subunit and the infrared thermal imaging subunit are respectively connected to the image processing unit;

[0021] The visible light camera subunit is used to collect high-resolution visible light images and provide clear visual information of the target area;

[0022] The infrared thermal imaging subunit is used to obtain an infrared thermal image of a target, reflect the temperature distribution of the target, and assist in target identification.

[0023] The flight control module includes a navigation unit and an attitude adjustment unit, and the navigation unit and the attitude adjustment unit are respectively connected to the UAV;

[0024] The navigation unit is used to provide accurate positioning and navigation services for the UAV, ensuring that the UAV flies according to the predetermined route;

[0025] The attitude adjustment unit is used to adjust the attitude of the UAV in real time according to the flight status and environmental factors to maintain flight stability.

[0026] The ground control center includes a video stream processing module and a user interaction module, and the video stream processing module and the user interaction module are respectively connected to the signal base station;

[0027] The video stream processing module is used to decode the received video stream to obtain a video frame sequence and pass it to the user interaction module;

[0028] The user interaction module is used to display the images captured by the drone in real time, and the operator observes the current environment through a graphical interface and selects and tracks targets.

[0029] Wherein, the user interaction module includes a display unit, a target selection unit and an instruction processing unit, and the display unit, the target selection unit and the instruction processing unit are respectively connected to the signal base station;

[0030] The display unit is used to display the images captured by the drone in real time, and the operator observes the current environment through a graphical interface;

[0031] The target selection unit is used by the operator to confirm the target through the mouse, and the target information is transmitted to the system for subsequent processing;

[0032] The instruction processing unit is used to generate corresponding UAV pod control instructions based on the confirmed target information, and send the control instructions back to the UAV through the signal base station to instruct it to start target tracking.

[0033] The present invention provides an optoelectronic pod target locking system based on universal segmentation, wherein the signal base station is responsible for receiving the video stream transmitted by the drone and transmitting the video stream to the ground control center in real time. The signal base station is also responsible for receiving instructions from the ground control center and forwarding them to the drone to command the drone to perform corresponding operations. The ground control center displays the images captured by the drone in real time. The operator observes the current environment through a graphical interface and selects and tracks targets. The drone serves as the mobile platform of the system and performs reconnaissance missions. The flight control module controls the attitude, altitude, speed and path planning of the drone. The optoelectronic pod module provides real-time video streaming to support remote monitoring and decision-making. The wireless transmission module transmits the drone data to the ground control center in real time to support the issuance of remote control instructions. Through the above-mentioned method, it is achieved that the accuracy and real-time performance of target tracking in various scenarios can be improved, the adaptability and versatility of the system can be enhanced, and the needs of modern combat and reconnaissance can be met. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0035] Figure 1 It is a schematic diagram of the principle of the optoelectronic pod target locking system based on universal segmentation of the present invention.

[0036] Figure 2 It is a schematic diagram of the principle of the optoelectronic pod module of the present invention.

[0037] Figure 3 It is a schematic diagram of the principle of the user interaction module of the present invention.

[0038] Figure 4 The present invention is a flowchart of issuing tracking instructions for the optoelectronic pod target locking system based on universal segmentation.

[0039] 10-UAV component, 20-signal base station, 30-ground control center, 101-UAV, 102-flight control module, 103-photoelectric pod module, 104-wireless transmission module, 1021-navigation unit, 1022-attitude adjustment unit, 1031-sensor unit, 1032-image processing unit, 10311-visible light camera subunit, 10312-infrared thermal imaging subunit, 10321-preprocessing subunit, 10322-general segmentation subunit, 301-video stream processing module, 302-user interaction module, 3021-display unit, 3022-target selection unit, 3023-instruction processing unit. DETAILED DESCRIPTION

[0040] The following describes embodiments of the present invention in detail, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and are not to be construed as limiting the present invention.

[0041] See also Figures 1 to 4 The present invention provides an optoelectronic pod target locking system based on universal segmentation, comprising an unmanned aerial vehicle component 10, a signal base station 20, and a ground control center 30, wherein the unmanned aerial vehicle component 10 is connected to the signal base station 20, and the ground control center 30 is connected to the signal base station 20;

[0042] The drone assembly 10 includes a drone 101, a flight control module 102, an optoelectronic pod module 103, and a wireless transmission module 104. The wireless transmission module 104 is connected to the signal base station 20, the flight control module 102 is connected to the drone 101, and the drone 101, the flight control module 102, and the optoelectronic pod module 103 are respectively connected to the wireless transmission module 104.

[0043] The signal base station 20 is responsible for receiving the video stream transmitted by the UAV 101 and transmitting the video stream to the ground control center 30 in real time;

[0044] The ground control center 30 is used to display the images captured by the UAV 101 in real time, and the operator observes the current environment through a graphical interface and selects and tracks targets;

[0045] The UAV 101 is used as a mobile platform of the system to perform reconnaissance missions;

[0046] The flight control module 102 is used to control the attitude, altitude, speed and path planning of the UAV 101;

[0047] The optoelectronic pod module 103 is used to provide real-time video streaming to support remote monitoring and decision-making;

[0048] The wireless transmission module 104 is used to transmit the data of the UAV 101 to the ground control center 30 in real time, supporting the issuance of remote control instructions.

[0049] In this embodiment, the signal base station 20 is responsible for receiving the video stream transmitted by the drone 101 and transmitting the video stream to the ground control center 30 in real time. The signal base station 20 is also responsible for receiving instructions from the ground control center 30 and forwarding them to the drone 101 to command the drone 101 to perform corresponding operations. The ground control center 30 displays the images captured by the drone 101 in real time. The operator observes the current environment through a graphical interface and selects and tracks targets. The drone 101 serves as the mobile platform of the system and performs reconnaissance missions. The flight control module 102 controls the attitude, altitude, speed and path planning of the drone 101. The optoelectronic pod module 103 provides real-time video streaming to support remote monitoring and decision-making. The wireless transmission module 104 transmits data from the drone 101 to the ground control center 30 in real time to support the issuance of remote control instructions. Through the above-mentioned method, the accuracy and real-time performance of target tracking in various scenarios are improved, and the adaptability and versatility of the system are enhanced, thereby meeting the needs of modern combat and reconnaissance.

[0050] Furthermore, the optoelectronic pod module 103 includes a sensor unit 1031 and an image processing unit 1032 , the image processing module is connected to the wireless transmission module 104 , and the sensor unit 1031 is connected to the graphics processing unit;

[0051] The sensor unit 1031 is used to capture real-time video stream;

[0052] The image processing unit 1032 is used to process the video image.

[0053] In this embodiment, the sensor unit 1031 captures real-time video streams and transmits the video streams to the signal base station 20 via the wireless transmission module 104. The image processing unit 1032 processes the video images to facilitate subsequent target recognition.

[0054] Furthermore, the image processing unit 1032 includes a pre-processing sub-unit 10321 and a general segmentation sub-unit 10322, and the pre-processing sub-unit 10321 and the general segmentation sub-unit 10322 are respectively connected to the wireless transmission module 104;

[0055] The pre-processing sub-unit 10321 is used to perform denoising and enhancement processing on the collected image;

[0056] The general segmentation subunit 10322 is used to perform pixel-level segmentation on the object on which the mouse is hovering, distinguish the target from the background, and accurately extract the target features.

[0057] In this embodiment, the pre-processing sub-unit 10321 performs denoising and enhancement processing on the collected image, which is beneficial for the subsequent recognition of the target. The general segmentation sub-unit 10322 performs pixel-level segmentation on the object where the mouse is hovering, distinguishes the target from the background, and accurately extracts the target features. In addition, the recognition ability of the target in complex backgrounds and low-light conditions is enhanced, thereby reducing the probability of misidentification and missed identification. By adopting the convolutional neural network (CNN) algorithm framework, any target can be stably segmented, so that the system can adapt to different scenarios, environments and target types, thereby improving the flexibility and reliability of the system.

[0058] Furthermore, the sensor unit 1031 includes a visible light camera subunit 10311 and an infrared thermal imaging subunit 10312, and the visible light camera subunit 10311 and the infrared thermal imaging subunit 10312 are respectively connected to the image processing unit 1032;

[0059] The visible light camera subunit 10311 is used to collect high-resolution visible light images and provide clear visual information of the target area;

[0060] The infrared thermal imaging subunit 10312 is used to obtain an infrared thermal image of a target, reflect the temperature distribution of the target, and assist in target identification.

[0061] In this embodiment, the visible light camera subunit 10311 captures high-resolution visible light images to provide clear visual information of the target area, and the infrared thermal imaging subunit 10312 obtains infrared thermal images of the target to reflect the temperature distribution of the target and assist in target identification. Later, the visible light image and the infrared thermal image are fused to comprehensively utilize the information of the two images to facilitate target identification.

[0062] Furthermore, the flight control module 102 includes a navigation unit 1021 and an attitude adjustment unit 1022, and the navigation unit 1021 and the attitude adjustment unit 1022 are respectively connected to the UAV 101;

[0063] The navigation unit 1021 is used to provide accurate positioning and navigation services for the UAV 101, ensuring that the UAV 101 flies according to the predetermined route;

[0064] The attitude adjustment unit 1022 is used to adjust the attitude of the UAV 101 in real time according to the flight status and environmental factors to maintain flight stability.

[0065] In this embodiment, the navigation unit 1021 provides accurate positioning and navigation services for the drone 101 to ensure that the drone 101 flies according to the predetermined route. The attitude adjustment unit 1022 adjusts the attitude of the drone 101 in real time according to the flight status and environmental factors to maintain flight stability.

[0066] Furthermore, the ground control center 30 includes a video stream processing module 301 and a user interaction module 302, and the video stream processing module 301 and the user interaction module 302 are respectively connected to the signal base station 20;

[0067] The video stream processing module 301 is used to decode the received video stream to obtain a video frame sequence and pass it to the user interaction module 302;

[0068] The user interaction module 302 is used to display the images captured by the drone 101 in real time, and the operator observes the current environment through a graphical interface and selects and tracks targets.

[0069] In this embodiment, the video stream processing module 301 performs target recognition on the images in the video stream and determines the type and attributes of the target. The user interaction module 302 displays the images captured by the drone 101 in real time. The operator observes the current environment through a graphical interface and selects and tracks the target.

[0070] Furthermore, the user interaction module 302 includes a display unit 3021, a target selection unit 3022 and an instruction processing unit 3023, and the display unit 3021, the target selection unit 3022 and the instruction processing unit 3023 are respectively connected to the signal base station 20;

[0071] The display unit 3021 is used to display the images captured by the drone 101 in real time, and the operator observes the current environment through a graphical interface;

[0072] The target selection unit 3022 is used by the operator to confirm the target by using the mouse, and the target information is transmitted to the system for subsequent processing;

[0073] The instruction processing unit 3023 is used to generate corresponding UAV 101 pod control instructions based on the confirmed target information, and send the control instructions back to the UAV 101 through the signal base station 20 to instruct it to start target tracking.

[0074] In this embodiment, the display unit 3021 displays the image captured by the drone 101 in real time, and the operator observes the current environment through a graphical interface. The operator of the target selection unit 3022 confirms the target by using the mouse and selects the target of interest in the video stream. The system highlights the target area for confirmation. When the operator moves the mouse, the system applies a general segmentation algorithm to process the target pointed by the mouse, automatically identifies and segments the target area in real time. This process provides a smooth human-computer interaction experience while ensuring accurate target separation in complex backgrounds. After the operator confirms the target by clicking, the instruction processing unit 3023 generates the corresponding drone 101 pod control instruction based on the confirmed target information, and sends the control instruction back to the drone 101 through the signal base station 20, instructing it to start target tracking.

[0075] The above disclosure is only a preferred embodiment of the present invention, and certainly cannot be used to limit the scope of the rights of the present invention. Ordinary technicians in this field can understand that all or part of the processes of the above embodiment and equivalent changes made in accordance with the claims of the present invention are still within the scope of the invention.

Claims

1. An optoelectronic pod target locking system based on universal segmentation, characterized in that: It includes a drone component, a signal base station and a ground control center, wherein the drone component is connected to the signal base station, and the ground control center is connected to the signal base station; The UAV assembly includes a UAV, a flight control module, an optoelectronic pod module and a wireless transmission module, wherein the wireless transmission module is connected to the signal base station, the flight control module is connected to the UAV, and the UAV, the flight control module and the optoelectronic pod module are respectively connected to the wireless transmission module; The signal base station is responsible for receiving the video stream transmitted by the drone and transmitting the video stream to the ground control center in real time; The ground control center is used to display the images captured by the UAV in real time, and the operator observes the current environment through a graphical interface and selects and tracks targets; The UAV is used as a mobile platform for the system to perform reconnaissance missions; The flight control module is used to control the attitude, altitude, speed and path planning of the UAV; The optoelectronic pod module is used to provide real-time video streaming to support remote monitoring and decision-making; The wireless transmission module is used to transmit the drone data to the ground control center in real time, supporting the issuance of remote control instructions.

2. The optoelectronic pod target locking system based on universal segmentation according to claim 1, characterized in that: The optoelectronic pod module includes a sensor unit and an image processing unit, the image processing module is connected to the wireless transmission module, and the sensor unit is connected to the graphics processing unit; The sensor unit is used to capture real-time video stream; The image processing unit is used to process the video image.

3. The optoelectronic pod target locking system based on universal segmentation according to claim 2, characterized in that: The image processing unit includes a pre-processing sub-unit and a general segmentation sub-unit, and the pre-processing sub-unit and the general segmentation sub-unit are respectively connected to the wireless transmission module; The pre-processing sub-unit is used to perform denoising and enhancement processing on the collected image; The general segmentation subunit is used to perform pixel-level segmentation on the object on which the mouse is hovering, distinguish the target from the background, and accurately extract the target features.

4. The optoelectronic pod target locking system based on universal segmentation according to claim 3, characterized in that: The sensor unit includes a visible light camera subunit and an infrared thermal imaging subunit, and the visible light camera subunit and the infrared thermal imaging subunit are respectively connected to the image processing unit; The visible light camera subunit is used to collect high-resolution visible light images and provide clear visual information of the target area; The infrared thermal imaging subunit is used to obtain an infrared thermal image of a target, reflect the temperature distribution of the target, and assist in target identification.

5. The optoelectronic pod target locking system based on universal segmentation according to claim 4, characterized in that: The flight control module includes a navigation unit and an attitude adjustment unit, and the navigation unit and the attitude adjustment unit are respectively connected to the UAV; The navigation unit is used to provide accurate positioning and navigation services for the UAV, ensuring that the UAV flies according to the predetermined route; The attitude adjustment unit is used to adjust the attitude of the UAV in real time according to the flight status and environmental factors to maintain flight stability.

6. The optoelectronic pod target locking system based on universal segmentation according to claim 5, characterized in that: The ground control center includes a video stream processing module and a user interaction module, and the video stream processing module and the user interaction module are respectively connected to the signal base station; The video stream processing module is used to decode the received video stream to obtain a video frame sequence and pass it to the user interaction module; The user interaction module is used to display the images captured by the drone in real time, and the operator observes the current environment through a graphical interface and selects and tracks targets.

7. The optoelectronic pod target locking system based on universal segmentation according to claim 6, characterized in that: The user interaction module includes a display unit, a target selection unit and an instruction processing unit, and the display unit, the target selection unit and the instruction processing unit are respectively connected to the signal base station; The display unit is used to display the images captured by the drone in real time, and the operator observes the current environment through a graphical interface; The target selection unit is used by the operator to confirm the target through the mouse, and the target information is transmitted to the system for subsequent processing; The instruction processing unit is used to generate corresponding UAV pod control instructions based on the confirmed target information, and send the control instructions back to the UAV through the signal base station to instruct it to start target tracking.

Images