Spacecraft parachute intelligent tracking system and method based on vehicle-mounted theodolite

Abstract

The invention relates to the technical field of target tracking, in particular to a spacecraft parachute intelligent tracking system and method based on a vehicle-mounted theodolite, and the system comprises the vehicle-mounted theodolite, a delivery device, an industrial personal computer, a video collection card, an image processing module, and an image digit conversion processing algorithm module which is used for converting image digits. The vehicle-mounted theodolite is connected with the industrial personal computer, the video acquisition card is connected with the industrial personal computer, the vehicle-mounted theodolite and the delivery equipment, the image processing module and the image digit conversion processing algorithm module are configured on the industrial personal computer, and the image processing module and the image digit conversion processing algorithm module can be operated through the industrial personal computer. The problems that an existing parachute tracking system is insufficient in illumination dependence, target misrecognition, environment adaptability, real-time processing capacity and feature learning are solved, the system tracking precision is high, robustness is high, and safety and reliability in the spacecraft landing process are remarkably improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of target tracking, and particularly relates to an intelligent tracking system and method for a spacecraft parachute based on a vehicle-mounted theodolite. Background Art

[0002] During the landing process of a spacecraft, the deployment and tracking of the parachute are important links to ensure the safe return of the spacecraft. However, existing parachute tracking algorithms and systems are prone to problems such as target loss or false tracking under complex environmental conditions, such as strong winds and light changes. Especially when the parachute is similar in shape to the return capsule, the tracking accuracy decreases, affecting the safe landing of the spacecraft.

[0003] Existing parachute tracking systems mainly rely on visible light cameras or infrared cameras for image acquisition, and use existing target tracking algorithms such as Kalman filtering, Meanshift, and Camshift to achieve the tracking of the parachute. However, these target tracking algorithms have many deficiencies in practical applications. First, strong light dependence is a significant problem. The performance of visible light cameras drops significantly under low light or backlight conditions, resulting in unstable tracking effects and difficulty in maintaining high-precision tracking in various lighting environments. Second, the problem of target misidentification is particularly prominent. Since the parachute and the return capsule are similar in shape at certain angles, existing target tracking algorithms are prone to misidentifying the return capsule as the parachute, leading to false tracking and thus affecting the overall reliability and safety of the tracking system. In addition, existing target tracking algorithms have poor robustness to occlusion and partial target loss. When the parachute is partially occluded by other objects during movement, existing target tracking algorithms are difficult to correctly handle the re-detection and recovery after target loss, resulting in frequent tracking interruptions or false tracking. Environmental adaptability is also a key issue. Under complex environmental conditions such as strong winds and heavy fog, the accuracy of existing target tracking algorithms decreases significantly, making it difficult to meet the requirements for high reliability in practical applications. More seriously, existing target tracking algorithms lack the ability of deep feature learning. They usually rely on manually designed features such as color histograms and HOG (Histogram of Oriented Gradient), and do not use deep learning methods to automatically learn more advanced features. This makes it difficult for existing target tracking algorithms to achieve sufficient discrimination and robustness in complex scenarios, especially in the case of the complex appearance and dynamic behavior of the parachute. At the same time, existing target tracking systems and algorithms have insufficient real-time processing capabilities when dealing with high-frame-rate image data, making it difficult to meet the efficient tracking requirements of more than 30fps, resulting in problems such as frame loss and unstable tracking.

[0004] There are also some existing target tracking systems that use dual cameras (visible light and infrared) and combine image fusion technology to improve tracking performance under different lighting conditions. At the same time, deep learning algorithms (such as YOLOv5, YOLOv8) are used for target detection to enhance the robustness and accuracy of the system. Although these systems solve the problems of light dependence and misidentification to a certain extent, they still have the following disadvantages: (1) High system complexity: The data fusion of dual cameras increases the system complexity and cost. (2) Low processing efficiency: Even with the use of deep learning algorithms, the real-time processing speed is still difficult to meet the high frame rate requirements. (3) Insufficient adaptability to specific environments: In extreme environments, such as under the influence of strong winds, the accuracy of target recognition and tracking is still limited. (4) Insufficient mechanism for correcting mis-tracking: There is a lack of effective strategies to correct mis-tracking, especially in the case of complex morphological changes. Summary of the Invention

[0005] In view of this, the present invention aims to provide an intelligent tracking system and method for spacecraft parachutes based on vehicle-mounted theodolites to improve the accuracy, real-time performance, and robustness of tracking.

[0006] To achieve the above object, the technical solution of the present invention is realized as follows: On the one hand, the present invention provides an intelligent tracking system for spacecraft parachutes based on vehicle-mounted theodolites, including a vehicle-mounted theodolite, an external transmission device, an industrial control computer, a video capture card, an image processing module, and an image bit conversion processing algorithm module for converting the image bits. The vehicle-mounted theodolite is connected to the industrial control computer, and the video capture card is connected to the industrial control computer, the vehicle-mounted theodolite, and the external transmission device. The image processing module and the image bit conversion processing algorithm module are configured on the industrial control computer, and the image processing module and the image bit conversion processing algorithm module can be run through the industrial control computer. Among them, the vehicle-mounted theodolite includes a theodolite body and a multi-spectral imaging device, and the multi-spectral imaging device is integrally installed on the theodolite body to collect image data and position data of the parachute in real time. The industrial control computer includes a processor, a memory, a graphics processor, a display device, and a storage module to perform real-time processing on the image data, display the tracking results in real time, and store the data.

[0007] Furthermore, the image processing module includes an OSTrack tracking algorithm module and a YOLOv8 target detection algorithm module to perform real-time tracking and auxiliary detection on the parachute. When the OSTrack tracking algorithm module loses the target, the YOLOv8 target detection algorithm module serves as an auxiliary decision-making tool, responsible for re-detecting the parachute and transmitting the detection results to the OSTrack tracking algorithm module to re-initialize the OSTrack tracking algorithm module.

[0008] Furthermore, the OSTrack tracking algorithm module uses the ViT-based single-stream object tracking algorithm OSTrack as the tracking algorithm, and the following optimizations and extensions are carried out: Joint feature learning and relationship modeling. By splicing the template image and the search region image and inputting them into the ViT encoder, the self-attention mechanism is used to distinguish the target from the background during the encoding stage, effectively generating discriminative target features. Early candidate elimination module. An early candidate elimination module is inserted into the multi-layer encoder of ViT. Using the similarity score between the template image and the search region image, background region candidates are dynamically eliminated. Mistracking correction. Combining the inverted triangle shape features of the parachute and the spacecraft and the morphological changes under the influence of wind, through shape matching and feature verification strategies, the parachute is correctly tracked and the spacecraft is prevented from being mis-tracked.

[0009] Furthermore, the YOLOv8 object detection algorithm module is trained using its own dataset and the weights are optimized to accurately identify the parachute.

[0010] Furthermore, the multi-spectral imaging device includes a visible light camera and an infrared camera. The visible light camera transmits image data to the video capture card through the SDI interface method. After the video capture card receives and processes the visible light image data, it is transmitted to the industrial control computer. After being processed by the image processing module configured on the industrial control computer, it is then transmitted to the external delivery device through the video capture card. The infrared camera is connected to the industrial control computer through RTSP. The image data collected by the infrared camera is transmitted to the industrial control computer through RTSP. After being processed by the image bit conversion processing algorithm module and the image processing module configured on the industrial control computer, it is then transmitted to the external delivery device through the video capture card.

[0011] On the other hand, the present invention provides an intelligent tracking method for a spacecraft parachute based on a vehicle-mounted theodolite. Based on the above-mentioned intelligent tracking system for a spacecraft parachute based on a vehicle-mounted theodolite, it includes: S1: Image acquisition: The vehicle-mounted theodolite collects image data of the parachute through a multi-spectral imaging device. The visible light image data collected by the multi-spectral imaging device is transmitted to the industrial control computer through the video capture card using the SDI interface method, and the infrared image data collected by the multi-spectral imaging device is transmitted to the industrial control computer through RTSP. S2: Image preprocessing: The visible light image data is directly input into the image processing module configured on the industrial control computer through the connection method of transmitting the SDI signal to the video capture card. The visible light image is preliminarily processed and directly used by the OSTrack tracking algorithm module. The 14-bit high-order image data collected by the infrared camera is processed by the image bit conversion processing algorithm module and converted into an 8-bit image format. The frame rate of the image data is identified. When the frame rate of the image data exceeds 50 fps, the frame extraction method is used. S3: Target tracking: Through the OSTrack tracking algorithm module, the parachute is tracked in real time by combining the shape features of the parachute and the spacecraft; the intelligent tracking system continuously monitors the size change of the parachute. If the size of the parachute changes abnormally, that is, the area of the parachute is greater than or equal to 2 times the area before the change, or less than or equal to 0.5 times the area before the change, it is determined that the target is lost, and go to step S4; S4: Auxiliary detection: The intelligent tracking system calls the YOLOv8 target detection algorithm module to perform target detection on the current frame image, identify the position of the parachute, use this position as the new tracking target, re-initialize the OSTrack tracking algorithm module, and achieve continuous tracking; otherwise, it is confirmed as a mis-tracked target, and the intelligent tracking system ignores this target and continues to call the YOLOv8 target detection algorithm module for re-detection until the position of the parachute is accurately identified.

[0012] Furthermore, in step S1, the visible light camera of the multispectral imaging device is responsible for capturing clear images of the parachute during the day and under good lighting conditions, while the infrared camera of the multispectral imaging device provides stable image capture capabilities under low light or night conditions to capture infrared images of the parachute.

[0013] Furthermore, step S3 includes the following steps: S31: Initialization: Manually select the initial position of the parachute through the user interface of the industrial control computer display device, or automatically detect the position of the parachute based on the spacecraft parachute intelligent tracking system of the vehicle-mounted theodolite, and initialize the OSTrack tracking algorithm module; S32: Real-time tracking and target loss detection: The parachute is tracked in real time through the OSTrack tracking algorithm module, and the bounding box coordinates of the parachute are output; the intelligent tracking system continuously monitors the size change of the parachute. If the size of the parachute changes abnormally, that is, the area of the parachute is greater than or equal to 2 times the area before the change, or less than or equal to 0.5 times the area before the change, it is determined that the target is lost, and go to step S4.

[0014] Furthermore, step S4 includes: When using the YOLOv8 target detection algorithm module to perform target detection on the current frame image to identify the position of the parachute, an anti-mis-tracking correction strategy is adopted. Combining the inverted triangle shape features of the parachute and the spacecraft and the morphological changes under the influence of wind, through shape matching and feature verification, ensure correct tracking of the parachute and avoid mis-tracking the return capsule. Specifically, it includes the following sub-steps: S41: Shape feature extraction: Using image processing technology, through edge detection and contour analysis, extract the shape features of each target detected by the YOLOv8 target detection algorithm module; S42: Shape matching and verification: Match the shape features obtained in step S41 with the inverted triangle shape features formed by the preset combination of the parachute and the spacecraft, and calculate the shape similarity score; Compare the shape similarity score with the preset shape similarity score threshold. If the shape similarity score is higher than the threshold, confirm that the target is the combination of the parachute and the return capsule, use this target position as the new tracking target, re-initialize the OSTrack tracking algorithm module to achieve continuous tracking; Otherwise, confirm it as a mis-tracked target, and the intelligent tracking system ignores this target and continues to call the YOLOv8 target detection algorithm module for re-detection until the position of the parachute is accurately identified; Among them, according to the morphological changes of the parachute, the preset shape similarity score threshold is dynamically adjusted.

[0015] Furthermore, the intelligent tracking system stores the tracking data during the tracking process in the storage module of the industrial control computer; The user can view the real-time position of the parachute through the display device; The user can manually select the tracking target, adjust or reset the tracking system, and view the tracking status and tracking system performance at any time.

[0016] Compared with the prior art, the present invention can achieve the following beneficial effects: The present invention supports the RTSP protocol image pulling function, meets the access requirements of multi-source video streams, and has the function of converting 14-bit infrared images to 8-bit display, improving the image processing and display effects. The present invention adopts the OSTrack tracking algorithm as the main tracking algorithm and introduces the YOLOv8 object detection algorithm as an auxiliary decision-making tool. When the tracked target is lost, the YOLOv8 object detection algorithm can be called to re-detect and identify the parachute in a timely manner, ensuring the continuity, accuracy, and real-time performance of the tracking. The present invention has high real-time processing capabilities. By using a high-performance industrial computer and GPU acceleration, a real-time processing speed of over 50fps is achieved, meeting the requirements of high-frame-rate tasks, and the stability and tracking accuracy of the tracking system are ensured through the frame extraction method. In addition, the present invention combines an incorrect tracking correction strategy. Through shape matching and feature verification, it ensures that the tracking system can accurately distinguish the parachute from the return capsule, avoiding incorrect tracking of the return capsule under the influence of wind, and further improving the robustness and safety of the tracking system in complex environments. The system of the present invention has a high degree of integration and supports two connection methods at the same time, ensuring the efficient synchronization and transmission of camera image data of different types, realizing the efficient transmission and synchronous processing of visible light image data and infrared image data, and reducing the complexity and maintenance cost of the system. The tracking system of the present invention can achieve fully automatic tracking, and the tracking data obtained after tracking (including the bounding box coordinates of the target, miss distance, etc.) can be effectively used for downstream tasks, further improving the application value and engineering feasibility of the tracking system. The present invention balances the real-time performance and accuracy of the tracking system. Through the early candidate elimination module and efficient algorithm design, while ensuring the tracking accuracy, the real-time processing capabilities of the tracking system are improved to adapt to various application scenarios. The present invention solves the problems of the existing parachute tracking system in terms of light dependence, incorrect target identification, environmental adaptability, real-time processing capabilities, and feature learning, and provides an intelligent tracking system and tracking method with high precision, strong robustness, and high real-time processing capabilities, significantly improving the safety and reliability during the spacecraft landing process. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings that form a part of the present invention are used to provide a further understanding of the present invention. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation to the present invention. In the drawings: Figure 1 It is a schematic structural diagram of the intelligent tracking system for spacecraft parachutes based on a vehicle-mounted theodolite according to an embodiment of the present invention; Figure 2 It is a schematic flowchart of the intelligent tracking method for spacecraft parachutes based on a vehicle-mounted theodolite according to an embodiment of the present invention; Figure 3Schematic diagram of the mis-tracking correction strategy process according to the embodiments of the present invention. Detailed implementation manners

[0018] In order to make the objectives, technical solutions and advantages of the present invention more clear and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, rather than limiting the present invention. Similar elements in different embodiments are labeled with related similar element numbers. In the following embodiments, many details are described to enable a better understanding of the present invention. However, those skilled in the art can easily recognize that some of the features can be omitted in different situations, or can be replaced by other elements, materials, or methods. In some cases, some operations related to the present invention are not shown or described in the specification, which is to avoid the core part of the present invention being overwhelmed by excessive description. For those skilled in the art, it is not necessary to describe these related operations in detail, and they can fully understand the related operations based on the description in the specification and the general technical knowledge in the art.

[0019] It should be noted that, without conflict, the embodiments in the present invention and the features in the embodiments can be combined with each other to form various embodiments. At the same time, the steps or actions in the method description can also be adjusted in the order that is obvious to those skilled in the art. Therefore, the various orders in the specification and the drawings are only for clearly describing a certain embodiment, and do not mean that they are the necessary orders, unless it is stated that a certain order must be followed.

[0020] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", etc. indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus cannot be understood as a limitation to the present invention. In addition, the terms "first", "second", etc. are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first", "second", etc. can explicitly or implicitly include one or more of such features. In the description of the present invention, unless otherwise stated, the meaning of "a plurality" is two or more.

[0021] In the description of the present invention, it should be noted that, unless otherwise clearly specified and defined, the terms "installation", "connection", and "coupling" should be understood in a broad sense. For example, it may be a fixed connection, a detachable connection, or an integral connection; it may be a mechanical connection or an electrical connection; it may be a direct connection or an indirect connection through an intermediate medium, and it may be the communication inside two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0022] The present invention will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0023] As Figures 1 to 3 shown, on the one hand, the present invention provides an intelligent tracking system for a spacecraft parachute based on a vehicle-mounted theodolite, including: a vehicle-mounted theodolite, an external transmission device, an industrial control computer, an image processing module, an image bit conversion processing algorithm module, and a DeckLink video capture card. The DeckLink video capture card is plugged into the industrial control computer and is connected to the vehicle-mounted theodolite and the external transmission device. The vehicle-mounted theodolite is connected to the industrial control computer, and the industrial control computer is connected to the external transmission device through the DeckLink video capture card. The image processing module and the image bit conversion processing algorithm module are configured on the industrial control computer, and the image processing module can be run through the industrial control computer, wherein: Vehicle-mounted theodolite: It includes a theodolite body and a multispectral imaging device. The multispectral imaging device is integrally installed on the theodolite body and is used to collect image data and position data of the parachute as the tracking target in real time. In some embodiments, the multispectral imaging device includes a visible light camera and an infrared camera.

[0024] Industrial control computer: It includes a processor, memory, graphics processor, display device, and storage module to perform real-time processing of image data, display tracking results in real-time, and store data for subsequent analysis and backtracking. In some embodiments, the processor is selected as Intel Core i9-14900k, providing powerful multi-core processing capabilities to meet the high-frame-rate real-time processing requirements; the memory is selected as 128GB DDR4 memory to ensure smooth operation of multi-tasking and large data streams; the graphics processor is selected as NVIDIA GeForce RTX 3080Ti GPU, which supports CUDA acceleration and can improve the inference speed of deep learning models; a 4TB NVMe solid-state drive is selected to provide fast data read and write capabilities to meet the storage requirements of large-capacity video image data; it is equipped with more than 3 PCIe slots and 1 PCIe X8 slot to support multi-graphics card and high-speed data transmission requirements; a dual-network card design supports high-speed data transmission and network redundancy. With the use of a high-performance industrial control computer and GPU acceleration, a real-time processing speed of over 50fps can be achieved. When the present invention exceeds 50fps, a frame sampling method is adopted, that is, tracking processing is performed every certain number of frames to balance system load and tracking accuracy, ensure system stability and tracking accuracy, and maintain real-time performance at the same time.

[0025] Image processing module: It includes an OSTrack tracking algorithm module and a YOLOv8 object detection algorithm module to perform real-time tracking and auxiliary detection of the parachute.

[0026] OSTrack is a single-stream object tracking algorithm based on Vision Transformer (ViT, a neural network architecture based on self-attention mechanism), which has the characteristics of high accuracy and high efficiency. The OSTrack tracking algorithm module of the present invention adopts OSTrack as the tracking algorithm and has been optimized and extended in the following aspects: joint feature learning and relation modeling, by splicing the template image and the search region image and inputting them into the ViT encoder, using the self-attention mechanism to distinguish the target from the background during the encoding stage, and effectively generating discriminative target features; an early candidate elimination module, inserting an early candidate elimination module in the multi-layer encoder of ViT, using the similarity score between the template image and the search region image to dynamically eliminate background region candidates, reducing the computational burden and improving the inference speed; mis-tracking correction, combining the shape features of the parachute and the return capsule (inverted triangle shape) and the morphological changes under the influence of wind, and ensuring correct tracking of the parachute and avoiding mis-tracking of the return capsule through shape matching and feature verification strategies. Among them, the acquisition of the similarity score belongs to the prior art, and reference can be made to "Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework, ECCV, 2022".

[0027] The YOLOv8 object detection algorithm module, as an auxiliary decision-making tool, enhances the robustness of the system in the case of target loss. The YOLOv8 object detection algorithm module is trained using its own dataset and optimizes the weights to enable accurate identification of parachutes. When the OSTrack tracking algorithm module loses the target, the YOLOv8 object detection algorithm module is responsible for re-detecting the parachute and passing the detection results to the OSTrack tracking algorithm module to re-initialize the OSTrack tracking algorithm module.

[0028] In the embodiments of the present invention, the image bit conversion processing algorithm module is used to convert the image bits, including linear or non-linear mapping, normalization processing, and color correction, to ensure that the image details are retained while adapting to the image format requirements of the display device.

[0029] The external delivery device includes an image output device that can be connected through an SDI interface, such as a professional monitor, a display screen with an SDI input interface, etc. The external delivery device is used to receive the data transmitted by the DeckLink video capture card. These data sources are of two types: one is the visible light image data collected by the visible light camera and processed by the industrial control computer; the other is the infrared image data collected by the infrared camera and processed sequentially by the image bit conversion processing algorithm module and the image processing module on the industrial control computer. The external delivery device converts the above two types of data into visual images for output.

[0030] In some embodiments, the visible light camera transmits the image data to the DeckLink video capture card through the SDI interface. SDI (Serial Digital Interface) is a digital signal interface widely used for video and audio transmission. The DeckLink video capture card is a hardware device for video capture and output, which supports the SDI interface. Specifically, the SDI signal output by the visible light camera is transmitted to the SDI input port of the DeckLink video capture card through a supporting connection cable. The DeckLink video capture card receives and decodes the SDI signal transmitted by the visible light camera, converts it into a format recognizable by the computer (such as the YUV or RGB format), and the processed image data is transmitted to the industrial control computer. After being processed by the image processing module configured on the industrial control computer, it is then transmitted to the DeckLink video capture card and transmitted to the external delivery device through the SDI output port of the DeckLink video capture card. This connection method is used for efficient transmission of image data through the SDI signal and is suitable for visible light cameras.

[0031] In some embodiments, the infrared camera is connected to the industrial control computer via RTSP. RTSP (Real-Time Streaming Protocol) is a protocol for video stream transmission and is widely used for pulling real-time video streams from remote video sources and streaming media servers. Specifically, the image data collected by the infrared camera is transmitted to the industrial control computer via RTSP. After being processed by the image bit number conversion processing algorithm module and the image processing module configured on the industrial control computer, it is then transmitted to the DeckLink video capture card and sent to the external device through the SDI output port of the DeckLink video capture card. This connection method is used to pull image data from the RTSP video source and is suitable for infrared cameras.

[0032] In the embodiments of the present invention, the visible light camera transmits visible light image data to the DeckLink video capture card through the SDI signal connection method for processing and then transmits it to the industrial control computer. The image data processed by the industrial control computer is then transmitted to the external device through the DeckLink video capture card. The infrared camera uses the RTSP connection method to pull the infrared image data to the industrial control computer for processing and is transmitted to the external device through the DeckLink video capture card. The present invention supports both of these connection methods simultaneously to ensure the efficient synchronization and transmission of image data of different types of cameras.

[0033] The intelligent tracking system for spacecraft parachutes based on a vehicle-mounted theodolite provided by the present invention can achieve efficient real-time processing. By using a high-performance industrial control computer and GPU acceleration, a real-time processing speed of over 50fps can be achieved. When the frame rate exceeds 50fps, a frame extraction method is adopted, that is, tracking processing is performed every certain number of frames to balance the system load and tracking accuracy, ensure system stability and tracking accuracy, and maintain real-time performance at the same time. At the same time, the present invention can achieve full-automatic tracking and data output. The system realizes full-automatic tracking, and the miss distance (target offset) obtained after tracking can be used for downstream tasks such as spacecraft position correction and data analysis, improving the application value of the system.

[0034] Reference Figures 1 - 3 , on the other hand, the present invention provides an intelligent tracking method for spacecraft parachutes based on a vehicle-mounted theodolite. Based on the above intelligent tracking system for spacecraft parachutes based on a vehicle-mounted theodolite, it includes the following steps: S1: Image Acquisition: The vehicle-mounted theodolite acquires the image data of the parachute as the tracking target through a multi-spectral imaging device. Among them, the visible light camera is responsible for capturing clear images of the parachute during the day and under good lighting conditions; the infrared camera provides stable image capture capabilities under low-light or night conditions to capture the infrared images of the parachute. The image data collected by the visible light camera is transmitted to the industrial control computer through the DeckLink video capture card in the SDI interface mode; the image data collected by the infrared camera is transmitted to the industrial control computer through RTSP, ensuring independent processing of image data of different spectra, realizing real-time transmission of image data, and ensuring the synchronization and efficiency of image data.

[0035] S2: Image Preprocessing: The image data collected by the visible light camera is directly input into the image processing module configured on the industrial control computer through the connection method of SDI signal transmission to the DeckLink video capture card. The visible light image undergoes preliminary processing, such as denoising and enhancement, and is directly used by the OSTrack tracking algorithm module.

[0036] The 14-bit high-bit image data collected by the infrared camera undergoes dynamic range compression and bit-depth conversion through the image bit conversion processing algorithm module, and is converted into an 8-bit image format. The conversion process includes linear or non-linear mapping, normalization processing, and color correction, ensuring that image details are retained while adapting to the 8-bit image format requirements of the display device.

[0037] S3: Target Tracking: Through the OSTrack tracking algorithm module, the parachute is tracked in real time by combining the shape characteristics of the parachute and the return capsule. The intelligent tracking system continuously monitors the size change of the parachute. If the size of the parachute changes abnormally, that is, the area of the parachute is greater than or equal to 2 times the area before the change, or less than or equal to 0.5 times the area before the change, it is determined that the target is lost, and it jumps to step S4, which specifically includes the following sub-steps: S31: Initialization: The user manually selects the initial position of the parachute through the user interface of the industrial control computer display device, or the intelligent tracking system of the spacecraft parachute based on the vehicle-mounted theodolite automatically detects the position of the parachute and initializes the OSTrack tracking algorithm module; S32: Real-time Tracking and Target Loss Detection: The OSTrack tracking algorithm module tracks the parachute in real time based on Vision Transformer and outputs the bounding box coordinates of the tracking target. The intelligent tracking system continuously monitors the size change of the tracking target. If the size of the tracking target changes abnormally, that is, the area of the tracking target is greater than or equal to 2 times the area before the change, or less than or equal to 0.5 times the area before the change, it is determined that the target is lost, and it jumps to step S4.

[0038] S4: Auxiliary Detection: The intelligent tracking system calls the YOLOv8 object detection algorithm module to perform object detection on the current frame image and identify the position of the parachute.

[0039] Further, in step S4, when the YOLOv8 object detection algorithm module performs object detection on the current frame image to identify the position of the parachute, an incorrect tracking correction strategy is adopted. Combining the shape features of the parachute and the return capsule (inverted triangle shape. The parachute is large, forming an inverted triangle shape when combined with the return capsule) and the morphological changes under the influence of wind, through shape matching and feature verification, ensure correct tracking of the parachute and avoid incorrect tracking of the return capsule, including the following sub-steps: S41: Shape Feature Extraction: Using image processing techniques, through edge detection and contour analysis, extract the shape features of each object detected by the YOLOv8 object detection algorithm module, and identify whether the object presents an inverted triangle shape and whether it conforms to the characteristics of the combination of the parachute and the return capsule.

[0040] S42: Shape Matching and Verification: Match the shape features obtained in step S41 with the inverted triangle shape features formed by the preset combination of the parachute and the return capsule, and calculate the shape similarity score. Compare the shape similarity score with the preset shape similarity score threshold. If the shape similarity score is higher than the threshold, confirm that the object is the combination of the parachute and the return capsule, use the position of this object as the new tracking target, re-initialize the OSTrack tracking algorithm module, and realize the continuous tracking of the tracking target; otherwise, confirm it as an incorrect tracking target, and the intelligent tracking system ignores this target and continues to call the YOLOv8 object detection algorithm module for re-detection until the position of the parachute is accurately identified.

[0041] Further, according to the morphological changes of the parachute caused by external factors such as wind, dynamically adjust the preset shape similarity score threshold to ensure accurate identification of the parachute even when the morphology of the parachute changes slightly.

[0042] Further, the present invention can achieve efficient real-time processing of image data. When the frame rate of the image data exceeds 50fps, a frame extraction method is adopted, that is, tracking processing is performed every set number of frames (such as 5 frames, 8 frames or 10 frames) to ensure the stability and tracking accuracy of the intelligent tracking system.

[0043] Further, the present invention stores the tracking data (including the bounding box coordinates of the target, the amount of deviation from the target, etc.) in the storage module (such as a solid-state drive), which can be used for downstream tasks.

[0044] The present invention can display the tracking results in real time, and users can view the real-time position of the parachute through a display device; it allows users to manually select the tracking target, adjust the tracking parameters, or reset the tracking system; it provides a real-time monitoring function, and users can view the tracking status and the performance of the tracking system at any time.

[0045] The present invention supports the function of pulling video streams according to the RTSP protocol, meets the access requirements of multi-source video streams, and has the function of converting 14-bit infrared images to 8-bit display, improving the image processing and display effects. The present invention uses the OSTrack tracking algorithm as the main tracking algorithm and introduces the YOLOv8 object detection algorithm as an auxiliary decision-making tool. When the tracking target is lost, the YOLOv8 object detection algorithm can be called to re-detect and identify the parachute in time, ensuring the continuity, accuracy, and real-time performance of the tracking. The present invention has high-efficiency real-time processing capabilities. Utilizing a high-performance industrial computer and GPU acceleration, it achieves a real-time processing speed of over 50fps, meeting the requirements of high-frame-rate tasks, and ensuring the stability and tracking accuracy of the tracking system through the frame extraction method. In addition, the present invention combines an anti-mis-tracking correction strategy. Through shape matching and feature verification, it ensures that the tracking system can accurately distinguish the parachute from the return capsule, avoiding mis-tracking the return capsule under the influence of wind, and further enhancing the robustness and safety of the tracking system in complex environments. The system of the present invention has a high degree of integration and supports two connection methods at the same time, ensuring the efficient synchronization and transmission of camera image data of different types, achieving the efficient transmission and synchronous processing of visible light image data and infrared image data, and reducing the complexity and maintenance cost of the system. The tracking system of the present invention can achieve full-automatic tracking, and the tracking data obtained after tracking (including the bounding box coordinates of the target, the amount of off-target, etc.) can be effectively used for downstream tasks, further enhancing the application value and engineering feasibility of the tracking system. The present invention balances the real-time performance and accuracy of the tracking system. Through the early candidate elimination module and efficient algorithm design, while ensuring the tracking accuracy, it improves the real-time processing capabilities of the tracking system and adapts to various application scenarios. The present invention solves the problems of the existing parachute tracking system in terms of light dependence, target mis-identification, environmental adaptability, real-time processing capabilities, and feature learning, and provides an intelligent tracking system and tracking method with high precision, strong robustness, and high real-time processing capabilities, significantly enhancing the safety and reliability during the spacecraft landing process.

[0046] It should be understood that various forms of the processes shown above can be used, with steps reordered, added, or deleted. For example, the steps recorded in the disclosure of the present invention can be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solution disclosed in the present invention can be achieved. No limitations are imposed herein.

[0047] The above specific embodiments do not constitute a limitation on the protection scope of the present invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims

1. A spacecraft parachute intelligent tracking system based on a vehicle-mounted theodolite, characterized in that: The invention comprises a vehicle-mounted theodolite, an external device, an industrial computer, a video acquisition card, an image processing module and an image bit number conversion processing algorithm module for converting the number of image bits. The vehicle-mounted theodolite is connected to the industrial computer, the video acquisition card is connected to the industrial computer, the vehicle-mounted theodolite and the external device, the image processing module and the image bit number conversion processing algorithm module are configured on the industrial computer, and the image processing module and the image bit number conversion processing algorithm module can be run through the industrial computer; wherein, the vehicle-mounted theodolite comprises a theodolite body and a multi-spectral camera device, the multi-spectral camera device is integrated and installed in the theodolite body, so as to collect the image data and the position data of the parachute in real time; the industrial computer comprises a processor, a memory, a graphics processor, a display device and a storage module, so as to process the image data in real time, display the tracking results in real time, and store the data.

2. The spacecraft parachute intelligent tracking system based on a vehicle-mounted theodolite according to claim 1, characterized in that: The image processing module includes an OSTrack tracking algorithm module and a YOLOv8 target detection algorithm module to perform real-time tracking and auxiliary detection of the parachute. When the OSTrack tracking algorithm module loses the target, the YOLOv8 target detection algorithm module, as an auxiliary decision-making tool, is responsible for re-detecting the parachute, passing the detection results to the OSTrack tracking algorithm module, and reinitializing the OSTrack tracking algorithm module.

3. The spacecraft parachute intelligent tracking system based on a vehicle-mounted theodolite according to claim 2 is characterized in that: The OSTrack tracking algorithm module uses the ViT-based single-stream target tracking algorithm OSTrack as the tracking algorithm, and performs the following optimizations and extensions: Joint feature learning and relationship modeling: by splicing the template image and the search area image into the ViT encoder, the self-attention mechanism is used to distinguish the target from the background in the encoding stage, effectively generating discriminative target features; Early Candidate Elimination Module, which is inserted into ViT’s multi-layer encoder and dynamically eliminates background region candidates using the similarity score between the template image and the search region image; Mistracking correction combines the inverted triangle shape characteristics of the parachute and the spacecraft and their morphological changes under the influence of wind, and ensures correct tracking of the parachute and avoids mistracking of the spacecraft through shape matching and feature verification strategies.

4. The spacecraft parachute intelligent tracking system based on a vehicle-mounted theodolite according to claim 2, characterized in that: The YOLOv8 target detection algorithm module uses its own data set for training and optimizes weights to accurately identify parachutes.

5. The spacecraft parachute intelligent tracking system based on a vehicle-mounted theodolite according to claim 1, characterized in that: The multispectral camera equipment includes a visible light camera and an infrared camera; the visible light camera transmits image data to a video capture card via an SDI interface, the video capture card receives and processes the visible light image data and transmits it to an industrial computer, after being processed by an image processing module configured on the industrial computer, it is then transmitted to an external device via the video capture card; the infrared camera is connected to the industrial computer via RTSP, the image data collected by the infrared camera is transmitted to the industrial computer via RTSP, after being processed by an image bit conversion processing algorithm module and an image processing module configured on the industrial computer, it is then transmitted to an external device via the video capture card.

6. A method for intelligent tracking of a spacecraft parachute based on a vehicle-mounted theodolite, characterized in that: The spacecraft parachute intelligent tracking system based on a vehicle-mounted theodolite according to any one of claims 1 to 5 comprises: S1: Image acquisition: The vehicle-mounted theodolite collects the image data of the parachute through the multi-spectral camera device. The visible light image data collected by the multi-spectral camera device is transmitted to the industrial computer through the video acquisition card using the SDI interface. The infrared image data collected by the multi-spectral camera device is transmitted to the industrial computer through RTSP; S2: Image preprocessing: Visible light image data is directly input into the image processing module configured on the industrial computer through the connection mode of SDI signal transmission to the video acquisition card. After preliminary processing, the visible light image is directly used by the OSTrack tracking algorithm module; the 14-bit high-bit image data collected by the infrared camera is processed by the image bit conversion processing algorithm module and converted into an 8-bit image format; the frame rate of the image data is identified. When the frame rate of the image data exceeds 50fps, the frame extraction method is adopted; S3: Target tracking: The parachute is tracked in real time by combining the shape characteristics of the parachute and the spacecraft through the OSTrack tracking algorithm module; the intelligent tracking system continuously monitors the size change of the parachute. If the parachute size changes abnormally, that is, the area of ​​the parachute is greater than or equal to 2 times the area before the change, or less than or equal to 0.5 times the area before the change, it is determined that the target is lost and the process goes to step S4; S4: Auxiliary detection: The intelligent tracking system calls the YOLOv8 target detection algorithm module to perform target detection on the current frame image, identifies the position of the parachute, uses this position as a new tracking target, reinitializes the OSTrack tracking algorithm module, and continues tracking; otherwise, if it is confirmed to be a mistracked target, the intelligent tracking system ignores the target and continues to call the YOLOv8 target detection algorithm module for redetection until the parachute position is accurately identified.

7. The intelligent tracking method for spacecraft parachute based on vehicle-mounted theodolite according to claim 6, characterized in that: In step S1, the visible light camera of the multispectral camera device is responsible for capturing clear images of the parachute in daytime and good lighting conditions, and the infrared camera of the multispectral camera device provides stable image capture capabilities in low light or night conditions to capture infrared images of the parachute.

8. The intelligent tracking method for spacecraft parachute based on vehicle-mounted theodolite according to claim 6, characterized in that: Step S3 includes the following steps: S31: Initialization: manually selecting the initial position of the parachute through the user interface of the industrial computer display device, or automatically detecting the parachute position through the spacecraft parachute intelligent tracking system based on the vehicle-mounted theodolite, and initializing the OSTrack tracking algorithm module; S32: Real-time tracking and target loss detection: The parachute is tracked in real time through the OSTrack tracking algorithm module, and the bounding box coordinates of the parachute are output; the intelligent tracking system continuously monitors the size changes of the parachute. If the size of the parachute changes abnormally, that is, the area of ​​the parachute is greater than or equal to 2 times the area before the change, or less than or equal to 0.5 times the area before the change, it is judged that the target is lost and go to step S4.

9. The intelligent tracking method for spacecraft parachute based on vehicle-mounted theodolite according to claim 6, characterized in that: Step S4 includes: when performing target detection on the current frame image through the YOLOv8 target detection algorithm module to identify the position of the parachute, a mistracking correction strategy is adopted, combining the inverted triangle shape characteristics of the parachute and the spacecraft and the morphological changes under the influence of wind, and ensuring correct tracking of the parachute through shape matching and feature verification to avoid mistracking of the return capsule, which specifically includes the following sub-steps: S41: Shape feature extraction: using image processing technology, through edge detection and contour analysis, the shape features of each target detected by the YOLOv8 target detection algorithm module are extracted; S42: shape matching and verification: match the shape feature obtained in step S41 with the inverted triangle shape feature formed by the preset combination of the parachute and the spacecraft, and calculate the shape similarity score; compare the shape similarity score with the preset shape similarity score threshold. If the shape similarity score is higher than the threshold, the target is confirmed to be a combination of the parachute and the return capsule, and the target position is used as a new tracking target. The OSTrack tracking algorithm module is reinitialized to continue tracking; otherwise, it is confirmed to be a mistracked target, and the intelligent tracking system ignores the target and continues to call the YOLOv8 target detection algorithm module for re-detection until the parachute position is accurately identified; wherein, the preset shape similarity score threshold is dynamically adjusted according to the morphological changes of the parachute.

10. The intelligent tracking method for spacecraft parachute based on vehicle-mounted theodolite according to claim 6, characterized in that: The intelligent tracking system stores the tracking data in the tracking process to the storage module of the industrial computer; Users can view the real-time position of the parachute through the display device; users can manually select tracking targets, adjust or reset the tracking system, and view the tracking status and tracking system performance at any time.

Images