A method for measuring the angular velocity of rocket fairing separation based on dense optical flow

Through a computer vision algorithm based on dense optical flow, the problem of poor picture quality in fairing separation angular velocity measurement is solved, stable tracking and high-precision angular velocity measurement are achieved, suitable for various fairing models, and the measurement is improved robust and anti-interference ability.

CN115035144BActive Publication Date: 2024-12-06BEIHANG UNIV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210413392.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-04-20
Publication Date
2024-12-06
Estimated Expiration
2042-04-20

AI Technical Summary

Technical Problem

The existing method of measuring the separation angular velocity of fairings is difficult to stably track the boundary area of ​​the fairings and perform velocity calculations when the picture quality is poor, and there are optical flow false alarms and noise problems, resulting in inaccurate measurement data.

Method used

Using a computer vision algorithm based on dense optical flow, the load area is removed through background modeling, and the fairing motion area is stably tracked using inter-frame difference and region threshold segmentation, and the motion information calculation of pixels in the fairing motion area is used by dense optical flow. , the angular velocity of the separation of the fairing is solved by combining the conversion relationship between two-dimensional pixel motion and three-dimensional target motion.

Benefits of technology

It realizes automatic capture of the boundaries of the fairing and calculates the separation angular velocity in the case of poor picture quality. It has high robustness and anti-interference ability. It is suitable for various models of fairings, providing high measurement accuracy and practical value.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115035144B_ABST
    Figure CN115035144B_ABST
Patent Text Reader

Abstract

This method aims to solve the problem that computer vision algorithms based on dense optical flow are difficult to stably track the boundary area of ​​fairing movement and calculate the speed under poor image quality. We propose a method for measuring the angular velocity of rocket fairing separation based on dense optical flow. First, background modeling is used to remove the load area, and then inter-frame difference and regional threshold segmentation are used to stably track the fairing movement area. Then, dense optical flow is used to calculate the motion information of pixels in the fairing movement area. Finally, the angular velocity of fairing separation is calculated based on the conversion relationship between two-dimensional pixel motion and three-dimensional target motion. This method can be used to analyze the real image of rocket fairing separation taken by the rocket-borne camera device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention is a method for measuring the angular velocity of rocket fairing separation based on dense optical flow. After the rocket-borne camera captures the fairing separation image, the method can capture the area where the fairing separation surface is located from the image, track the previous and next frame motion information of all pixel points in the area using dense optical flow, and model the conversion relationship between two-dimensional pixel motion and three-dimensional object motion, and calculate the angular velocity of fairing separation. The method can be used in the field of aerospace vehicle measurement and control. Background Art

[0002] The fairing can protect the launch vehicle's payload from various interference factors in the atmosphere. In order to save fuel and facilitate payload release, the fairing must be thrown away after the launch vehicle flies out of the atmosphere. For the two-petal fairing that uses a lateral rotation separation method, its top angular velocity during separation must meet the design requirements. Therefore, the measurement of the rocket fairing separation angular velocity is a key technology for evaluating the separation effect and the basis for the design of the fairing separation system. It is of great significance in improving the reliability of space launch missions. At present, the research on the measurement of the fairing separation angular velocity mainly includes three methods: one is software simulation test, the second is ground simulation test, and the third is real image analysis.

[0003] The software simulation test mainly uses finite element analysis and other methods to simulate the mechanical and motion characteristics of the fairing separation process. It builds a physical model based on the actual size of the fairing, assigns corresponding material properties to different areas, and then sets the number of finite element grids according to the accuracy requirements. Since the two-petal fairing is symmetrically distributed, the boundary conditions such as hinge constraints and spring forces are generally set for the single-side fairing to establish a dynamic system. The condition parameters of this method are easy to change, and real-time separation angular velocity data can be obtained. The simulation cost is low, but the boundary conditions are set too ideal during the test, which is different from the actual working conditions. Therefore, its angular velocity data can only be used as a reference.

[0004] In ground simulation tests, the gravity field can be used to simulate the overload effect when the fairing is separated. In order to eliminate the influence of atmospheric interference on the separation of the fairing, one method is to conduct the test in a large vacuum tank, and the other is to model the aerodynamic effect of the atmospheric environment. Although the former approximately simulates the actual working conditions, the test system equipment is expensive. The latter is often used in China to determine the difference between the test and the actual working conditions through quantitative analysis, so as to evaluate the correctness of the fairing separation design through ground tests. This method can be used to conduct experimental analysis on real fairings, but the aerodynamic factors in the simulation experiment are too complicated, including negative pressure and aerodynamic drag, so the measured separation angular velocity deviates from the actual situation.

[0005] The data for real image analysis comes from the onboard camera device, and the existing analysis method is mainly based on expert manual observation. Since the human eye is not sensitive to speed information, it is impossible to directly observe the law of angular velocity changes during the fairing separation stage. Therefore, in the absence of objective data assistance, manual observation has the risk of misjudgment. With the continuous development of computer vision technology, it is possible to extract target motion information using a monocular camera, which can provide objective data to assist manual judgment. The optical flow method is one of the methods to characterize the motion information of objects in adjacent frames. Depending on whether sparse points in the image are selected for optical flow estimation, the optical flow method can be divided into sparse optical flow and dense optical flow. Sparse optical flow calculates optical flow through feature corner points, while dense optical flow calculates optical flow for all pixels in the area. Due to the disturbance during the separation of the fairing, the image quality captured by the onboard camera device is poor. The flocculent debris that appears in the image during separation will form an occlusion, and the change in illumination will cause the static load to have an optical flow false alarm. Therefore, the sparse optical flow method is difficult to stably extract the feature corner points on the fairing, and the direct use of the dense optical flow method will introduce a lot of noise.

[0006] In view of the above problems, a method for measuring the angular velocity of rocket fairing separation based on dense optical flow is proposed. The algorithm realizes regional screening by modeling the characteristics of the fairing motion area, suppresses the optical flow false alarms in the load area and the space background area, and uses dense optical flow to calculate the velocity of the fairing motion boundary area. Then, according to the conversion relationship between two-dimensional pixel motion and three-dimensional target motion, the angular velocity change of the fairing separation is solved, which has high practical value. Summary of the invention

[0007] This method is dedicated to solving the problem that computer vision algorithms based on dense optical flow are difficult to stably track the boundary area of ​​the fairing movement and calculate the velocity under poor image quality. We propose a method for measuring the angular velocity of rocket fairing separation based on dense optical flow. First, background modeling is used to remove the payload area. Then, inter-frame difference and regional threshold segmentation are used to stably track the fairing movement area. Then, dense optical flow is used to calculate the motion information of pixels in the fairing movement area. Finally, the angular velocity of fairing separation is calculated based on the conversion relationship between two-dimensional pixel motion and three-dimensional target motion.

[0008] The rocket fairing separation angular velocity measurement method based on dense optical flow proposed in this invention has the following three advantages:

[0009] (1) Simple operation. After inputting relevant parameters, the algorithm can automatically capture the fairing boundary and calculate the separation angular velocity;

[0010] (2) Good versatility. After setting the corresponding parameters according to the fairing model, this method can measure the separation angular velocity of fairings of various models;

[0011] (3) It has high robustness and strong anti-interference ability and can be used under conditions of poor picture quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 Schematic diagram of the angular velocity measurement for the rocket fairing separation

[0013] Figure 2 Flowchart of the rocket fairing separation angular velocity measurement algorithm

[0014] Figure 3 The result of the measurement of the angular velocity of the rocket fairing separation is shown in Figure 2. DETAILED DESCRIPTION

[0015] The schematic diagram of the fairing separation process is attached. Figure 1 As shown on the left. Take the axis direction of the fairing as the z-axis, the normal of the separation plane as the x-axis, and the y-axis in the separation plane. In the process of fairing separation, the separation speed mainly refers to the speed v in the x-axis direction x , the breathing motion in the y-axis direction and the peeling speed in the z-axis direction can be ignored. The field of view of the arrow-borne camera is parallel to the z-axis, so the fairing separation diagram in the camera image is as shown in the attached figure. Figure 1 Shown on the right.

[0016] Where m and n are the horizontal and vertical axes of the camera image, respectively, and v s represents the velocity perpendicular to the separation plane. Since the breathing motion is much smaller than the separation velocity, the fairing in this process can be approximated as a rigid body. At the same time, the rotation of the fairing during separation is ignored, and only the translation is considered. Then the velocity of any point of the translation rigid body is equal, and v x =v s .

[0017] The camera's perspective projection model formula is as follows:

[0018]

[0019] Where (m,n) is the pixel coordinate, (x c ,y c ,z c ) is the camera coordinate, and the pixel coordinate of point A on the fairing at time t1 is (m1,n1), and the camera coordinate is (x c1 ,y c1 ,z c1 ), the pixel coordinates at time t2 are (m2,n 12 ), the camera coordinates are (x c2 ,y c2 ,z c2 ), then the actual velocity v of the point ca for:

[0020]

[0021] The pixel speed v of the point a for:

[0022]

[0023] During the separation process of the fairing, the movement speed of each point along the z-axis is much smaller than the separation speed, so it can be approximately considered that z c2 =z c1 =z c , then combining the above three equations we can get:

[0024]

[0025] When the camera imaging element is an ideal element, f m =f n =f0, we have:

[0026]

[0027] Similarly, if the pixel distance between two points at the same depth is known to be r and the actual distance is R, then both satisfy:

[0028]

[0029] The actual separation speed of the fairing is:

[0030]

[0031] Let the equivalent radius of the fairing rotation separation be L, then the corresponding separation angular velocity is:

[0032]

[0033] Based on the above principle, the flow chart of the rocket fairing separation angular velocity measurement algorithm is shown in the attached figure. Figure 2 The specific steps are as follows:

[0034] Step 1: Video capture of the fairing separation

[0035] The image of the fairing separation segment is intercepted from the original video stream to facilitate the subsequent extraction of the fairing motion area and optical flow sampling.

[0036] Step 2: Extraction of the fairing motion boundary area

[0037] Several frames are captured from the video sequence of the fairing leaving the field of view for background modeling. The load area is then removed by background subtraction, and the fairing boundary area is extracted by frame difference and threshold segmentation.

[0038] Step 3: Angular velocity calculation based on dense optical flow

[0039] Dense optical flow sampling is performed on the boundary area of ​​the fairing, and Gaussian modeling is performed on the sampling results to remove noise points. The mean of the remaining points is taken and substituted into the formula to calculate the fairing separation angular velocity.

Claims

1. A method for measuring the angular velocity of rocket fairing separation based on dense optical flow, characterized in that: The steps include: Step 1: Use Gaussian background modeling to remove the load area in the field of view; Step 2: Use inter-frame difference and regional threshold segmentation to stably track the fairing motion area; Step 3: Use dense optical flow to calculate the motion information of pixels in the fairing motion area, and calculate the angular velocity of the fairing separation based on the conversion relationship between two-dimensional pixel motion and three-dimensional target motion, including: The fairing is approximately a rigid body. The rotation of the fairing when it is separated is ignored. Only the translation is considered. The speed of any point of the translation rigid body is equal, so v x =v s , v x represents the actual separation speed of the fairing, v s represents the velocity perpendicular to the separation plane; The camera's perspective projection model formula is as follows: Among them, m, n are the horizontal axis and vertical axis of the camera image, (m, n) is the pixel coordinate, (x c ,y c ,z c ) is the camera coordinate, and the pixel coordinate of point A on the fairing at time t1 is (m1,n1), and the camera coordinate is (x c1 ,y c1 ,z c1 ), the pixel coordinates at time t2 are (m2,n 12 ), the camera coordinates are (x c2 ,y c2 ,z c2 ), then the actual velocity v of point A ca for: The pixel speed v of the point a for: During the separation process of the fairing, the speed of each point along the z axis is c2 =z c1 =z c , then combining the above three equations, we get: When the camera imaging element is an ideal element, f m =f n =f0, we have: Similarly, if the pixel distance between two points at the same depth is known to be r and the actual distance is R, then both satisfy: Then the actual separation speed of the fairing v x for: Let the equivalent radius of the fairing rotation separation be L, then the corresponding separation angular velocity ω is: