Tower falling test load motion multi-parameter monocular vision synchronous measurement method
By calibrating with a monocular vision system and matching feature points, synchronous measurement of load motion parameters was achieved, solving the problem of large measurement errors in existing technologies, simplifying the system structure and improving measurement accuracy.
Patent Information
- Application Number
- CN202411170657.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-26
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2044-08-26
AI Technical Summary
Existing monocular vision technology cannot acquire stereo information, and binocular stereo vision technology has a complex system structure and many difficulties in matching algorithms, resulting in large measurement errors of load motion parameters in drop tests and making it difficult to achieve synchronous measurement.
By employing a monocular vision system, camera parameters are calibrated, visual feature points are extracted and matched, a target coordinate system is established, rotation and translation matrices are calculated, and the centroid trajectory and rotation trajectory are fitted to achieve synchronous measurement of load motion parameters.
The measurement system structure was simplified, measurement errors were reduced, and multi-parameter synchronous measurement of the load target was achieved, including accurate measurement of translation direction, velocity, rotation direction and angular velocity.
Smart Images

Figure CN119044529A_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of visual measurement, and in particular relates to a method for synchronously measuring multi-parameter monocular vision of load motion in a drop tower test. Background Art
[0002] In recent years, my country's aerospace technology has developed rapidly, and the diversification of aerospace functional requirements has put forward new requirements for spacecraft structures. The separation and unlocking device is an important component of the spacecraft system. It has been used in satellite-rocket separation, loading equipment separation, etc., and has played an important role in spacecraft launch, flight and on-orbit work. The impact vibration generated during the launch of the spacecraft can easily damage the high-precision instruments on board. The separation and unlocking device is tightly connected to it to provide rigid support for the instrument payload in the launch phase and play a fixed protection role. After the spacecraft reaches the designated orbit, the constraints between the payload and the spacecraft platform are safely and reliably released, releasing the instrument payload's freedom. In some cases, there are clear restrictions on the motion parameters of the instrument payload, such as separation speed, separation direction, and separation speed. Therefore, a drop tower test is generally carried out on the ground to measure the motion parameters of the separation load and verify the separation performance of the separation and unlocking device.
[0003] Visual measurement technology is a non-contact measurement technology with the advantages of high precision, strong adaptability, and high reliability. It has been widely used in the aerospace industry. According to the number of cameras, it can be divided into monocular vision technology and binocular stereo vision technology. Binocular stereo vision technology can solve the three-dimensional coordinates of the target through the parallax between different perspectives, but its measurement system structure is complex, and high-precision matching of binocular same-name points under dynamic conditions is relatively difficult, which often causes matching errors, asynchronous errors, and binocular positioning errors; the measurement system structure of monocular vision measurement technology is simple, there is no synchronization error and the matching error is small, but it cannot obtain the stereo information of the target.
[0004] Therefore, in order to overcome the shortcomings of the complex system structure of binocular vision technology and the inability of monocular vision technology to obtain stereo information, and to realize the measurement of parameters such as the translation direction, translation speed, rotation direction and rotation angular velocity of the target load, the present invention proposes an effective multi-parameter synchronous measurement method for the drop tower test load motion based on a monocular vision system. Summary of the invention
[0005] The technical problem to be solved by the present invention is: in a drop tower test, the shortcomings of the existing monocular vision technology and binocular stereo vision technology are overcome, and an effective method for synchronously measuring multiple parameters of the motion of a separated load based on a monocular vision system is provided, including the translation direction, translation speed, self-rotation direction and self-rotation angular velocity of the load target. This method not only helps to simplify the structure of the measurement system, but also avoids the difficulties of the matching algorithm, reduces the sources of measurement errors, and realizes the synchronous measurement of multiple parameters of the motion of the measured load target.
[0006] The technical solution of the present invention is: a method for synchronously measuring multi-parameter monocular vision of load motion in a drop tower test, characterized in that:
[0007] S1: Calibrate the internal parameter matrix A and distortion coefficient vector d of the measurement camera; calculate the center of mass position of the target load; use the calibrated monocular camera to collect N frames of measurement images when the target load is moving, extract the visual feature points in the measurement images, and sort and match the visual feature points;
[0008] S2: Take the center of mass of the target load as the coordinate origin and establish the target coordinate system Ox on the target load o y o z o , according to the visual feature points extracted in step S1, calculate the coordinate system of the target to the camera coordinate system O at different times c -x c y c z c The rotation matrix and translation vectors i=1,2,···,N;
[0009] S3: By rotation matrix and translation vectors The target load center of mass is converted to the camera coordinate system, and the center of mass coordinates are used to fit the center of mass trajectory line L to obtain the translation direction n of the target load; the center of mass coordinates are projected onto the line L, and the translation speed v of the target load is calculated using the center of mass projection point;
[0010] S4: By rotation matrix Obtain the rotation characteristic point P of the target load at different times i , using the rotation feature point P i Fit the target load rotation trajectory plane π; according to the perpendicular constraint and the center coplanar constraint, fit the target load rotation trajectory circle in the plane π, and calculate the coordinate of the center C of the rotation trajectory circle; i After projecting the center C onto the plane π, the coordinates of the feature projection point center projection point are reduced in dimension, and the reduced-dimensional coordinates are used to calculate the rotation angle θ and rotation speed ω of the target load.
[0011] Furthermore, the specific operation steps of step S1 include:
[0012] S101: The camera is fixed, a dot target is placed in front of the camera, the position and direction of the dot target are adjusted, 10 to 15 target images with different poses are collected using a measuring camera, and the internal parameter matrix A and the distortion coefficient vector d of the measuring camera are calibrated using the Zhang Zhengyou camera calibration method.
[0013] S102: Calculating the center of mass position of the target load according to the structure and density information of the target load;
[0014] S103: designing a cooperative marking dot array on a certain plane of the target load, and using a calibrated measurement camera to collect N frames of measurement images including the cooperative marking dot array when the target load moves;
[0015] S104: extracting the ellipse corresponding to the cooperative marking point in the measurement image, and calculating the coordinates of the common tangent point of the ellipse as the measurement feature point of the target load;
[0016] S105: sorting the extracted feature points in each frame image, and matching the feature points in different frame images according to the sorting result.
[0017] Furthermore, the specific operation steps of step S3 include:
[0018] S301: According to the rotation matrix and translation vectors The target load mass center O at different times i Coordinates are converted to camera coordinates
[0019] S302: Using the centroid point O at different times i Fit the space straight line L and obtain the direction vector n of the straight line L in the camera coordinate system, then the translation direction of the target load is n;
[0020] S303: The centroid points O at different times i Project it onto the line L and get the projection point The coordinate vector is Through the projection point The translation velocity v of the target load is calculated by using the coordinates and time difference:
[0021]
[0022] Where ΔT represents the time interval between adjacent frames of the measurement camera, and m and n represent the number of frames.
[0023] Furthermore, the specific operation steps of step S4 include:
[0024] S401: According to the rotation matrix Set the target coordinate system O of the i-th frame i -x o,i y o,i z o,i The unit reference vector under Convert the unit vector to the camera coordinate system Vector The end point of the rotation feature point P i , construct the rotation feature point set S = {P i |i=1,2,···,N};
[0025] S402: Let the set S ′ =S, use set S ′ Fit the equation of plane π and calculate P i The distance d to the plane π i ,like Make d i >d0, then from the set S ′ Eliminate P i , and refit the plane until it satisfies d i ≤d0;
[0026] S403: According to the perpendicular bisector constraint and the circle center coplanar constraint, a spatial circle fitting optimization function is constructed, and the extreme value points of the optimization function are calculated to obtain the three-dimensional coordinates of the center C of the fitting circle trajectory and the linear equation of the self-rotation axis, where: the perpendicular bisector constraint is defined as the set S ′ The perpendicular bisector of the line connecting any two points in the circle must pass through the center of the circle; the center coplanarity constraint is defined as the center of the circle being within the fitting plane π;
[0027] S404: Project the set S and the center C onto the plane π to obtain the set S π and the center C π , establish the plane coordinate system O in plane π d -x d y d , the set S π and the center C π Perform coordinate dimensionality reduction to obtain its d -x d y d Two-dimensional coordinates in the coordinate system and X C,d , the rotation angle θ and rotation angular velocity ω of the target load are calculated by the following formula:
[0028] The advantages of the present invention over the prior art are as follows: the present invention aims at the problem of multi-parameter measurement of target load motion in drop tower separation test, and proposes a multi-parameter synchronous measurement method of target load motion based on a monocular vision system. The proposed method can realize multi-parameter measurement of target load motion based on monocular vision technology, which not only overcomes the problem that monocular vision technology cannot obtain target stereo information, but also avoids the shortcomings of complex structure and difficult algorithm of binocular stereo vision technology, realizes the synchronous measurement of translation direction, translation speed, self-rotation direction and self-rotation angular velocity of target load separation motion in drop tower test, and provides guidance for the measurement of motion parameters of composite motion. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] The above advantages of the present invention will become obvious and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings. The accompanying drawings are only used to illustrate the embodiments of the present invention and are not used to limit the present invention.
[0030] Figure 1 This is a flow chart of the method for synchronously measuring multi-parameters of target motion based on monocular vision in the present invention;
[0031] Figure 2 A schematic diagram of a cooperative marking point array in the present invention;
[0032] Figure 3 It is a schematic diagram of the target load dynamics analysis in the present invention;
[0033] Figure 4 It is a schematic diagram of the measurement process in the present invention;
[0034] Figure 5 This is a flow chart of the rotation parameter measurement method of the present invention. DETAILED DESCRIPTION
[0035] The specific implementation modes of the present invention are described in detail below with reference to the accompanying drawings.
[0036] The measuring camera is fixed and a dot target is placed in front of the measuring camera. The posture and position of the dot target are adjusted and 10 to 15 calibration images with different target postures are collected using the measuring camera. The calibration images are preprocessed to extract the centers of the feature points of the image targets. The internal parameter matrix A and the distortion coefficient vector d of the measuring camera are calculated according to Zhang Zhengyou's paper "A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence [J]. 2000, 22(11): 1330-1334".
[0037] like Figure 2 , a cooperative marking point array is designed on one of the surfaces of the target payload, taking a 2×2 array, a marking point diameter of 20mm, and a spacing of 40mm between adjacent points as an example.
[0038] like Figure 3 Taking a uniform rectangular target load as an example, its center of mass is located at the center of the rectangle. In the drop tower test, under the action of a certain instantaneous impact force F, the target load moves in a translational motion with a speed v along the direction of the force F, accompanied by a rotation axis l r , self-rotation motion with angular velocity ω, where v has three degrees of freedom, l r There are three degrees of freedom.
[0039] like Figure 4 During the separation process of the target load, the measuring camera collects multiple frames of images. With the center of mass O of the target load as the origin, the target coordinate system Ox is established. o y o z o , the target coordinate system is synchronized with the target load.
[0040] like Figure 1 , the target load translation parameter measurement method, the specific steps are as follows:
[0041] (1) Extract the imaging ellipse of the cooperative marker point in the measurement image. Specifically, the extraction method is the EDCircles method in the paper "EDCircles:A real-time circle detector with a false detection control. 2013, 46 (3), 725-740", and sort the extracted image ellipses; calculate the common tangent point between any two ellipses. The extraction algorithm refers to the paper "UAV landing position and posture visual measurement method based on double circle features. Acta Aeronautica Sinica, 2005 (03): 344-348", and sort the extracted common tangent points. Calculate the target coordinate system O of the i-th frame using the PnP algorithm and the common tangent point coordinates i -x o,i y o,i z o,i To the camera coordinate system O c -x c y c z c The rotation matrix and translation vectors i=1,2,···,N.
[0042] (2) The target load center of mass point O is transformed by the rigid body transformation of the coordinate system. i (i.e. the origin of the target coordinate system) coordinates are converted to the coordinates of the camera coordinate system
[0043]
[0044] (3) Using coordinates Fitting, we get the centroid fitting straight line L in the sense of least squares, which can be expressed as:
[0045]
[0046] Among them, the unit vector n L =(m1,n1,p1) Trepresents the direction of line L, and (x0, y0, z0) are the coordinates of any point on line L. Therefore, the translation direction of the target load is n L =(m1,n1,p1) T .
[0047] (4) Set the target centroid point O i Project it onto the fitting line L to get the centroid projection point Its coordinates are The projection formula is as follows:
[0048]
[0049] (5) Calculate the target load's velocity v based on the center of mass projection point coordinates:
[0050]
[0051] Where ΔT represents the time interval between adjacent frames of the measurement camera, and m and n represent the number of frames.
[0052] Define the reference vector in the target coordinate system Through the rotation matrix Get the direction vector of the reference vector in the target coordinate system of the i-th frame in the camera coordinate system The calculation formula is as follows:
[0053]
[0054] Take the origin as the starting point of the vector and The end point of the rotation is taken as the feature point, denoted as P i , whose coordinates are
[0055]
[0056] like Figure 1 , as shown in the target load rotation parameter measurement method, the specific Figure 5 As shown, let N0 = N, the specific steps are as follows:
[0057] (1) Construct a set S = {P i |i=1,2,···,N0}, and let S ′ =S;
[0058] (2) Through the set S ′ The points in the fitting space plane π: ax+by+cz-1=0;
[0059] (3) Calculate the set S ′ Point P i The distance d to the plane π i ;
[0060] (4) Determine the distance d i With a certain value d0, if Make d i >d0, then from the set S ′ Eliminate P i , and let N0=N0-1, and return to step (1);
[0061] (5) If d i ≤d0, then use the set S ′ The optimal equation of plane π is obtained by fitting;
[0062] (6) Let the coordinates of the center C of the space trajectory circle in the target coordinate system be X C =(x0,y0,z0), according to the "perpendicular midline constraint - set S ′ The perpendicular bisector of the line connecting any two points in the circle must pass through the center of the circle", and the following formula can be obtained:
[0063]
[0064] in,
[0065] Rearranging formula (6), we can get:
[0066]
[0067] in, and Similarly,
[0068] Write formula (7) in matrix form B·X C =L2, as follows:
[0069]
[0070] Let w = (a, b, c) T , according to the "circle center coplanar constraint - the circle center is located in the fitting plane π", the following formula can be obtained:
[0071] w T ·X C -1=0
[0072] The spatial circle fitting optimization function is constructed as follows:
[0073] f(X C ,λ=B·X C -L2 2 +λ·(w T X C -1
[0074] Here, λ is the Lagrange multiplier.
[0075] Let f(X C ,λtoX C Take the derivative of and λ, and set the derivative to 0, and rearrange it to get:
[0076]
[0077] Solving formula (9), we can get the three-dimensional coordinates of the center C, and the equation of the rotation axis is l r :
[0078] (7) Project the points in the set S onto the fitting plane π, P i The projection point on plane π is Its coordinates are Building a collection In addition, project the center C to point C on plane π π , the coordinate is X C,π ;
[0079] (8) Establish a plane coordinate system O in plane π d -x d y d , origin O d With C π Coincidence, O d x d Direction and Consistent, O d y d Direction and O d x d Vertical and located in plane π, O d x d and O d y d The unit vector in the target coordinate system is denoted by n x and n y ;
[0080] (9) Set S π Points inside and point C π Dimensionality reduction, from three-dimensional spatial coordinates to two-dimensional coordinates in plane π and X C,d , where X C,d =(0,0) T , The conversion formula is as follows:
[0081]
[0082] (10) According to and X C,dSolve the rotation angle θ and rotation speed ω of the target load:
[0083]
[0084] The above embodiments are provided only to describe the process of the present invention, and are not intended to limit the scope of the present invention. The scope of the present invention is defined by the appended claims. Various equivalent substitutions and modifications made without departing from the spirit and principles of the present invention should all be included within the scope of the present invention.
Claims
1. A method for synchronous measurement of multi-parameter monocular vision of load motion in drop tower test. It is characterized in that The following steps are involved: S1: Calibrate and measure the camera’s internal parameter matrix A and distortion coefficient vector d; Calculate the center of mass position of the target load; use the calibrated monocular camera to collect N frames of measurement images when the target load is moving, extract the visual feature points in the measurement images, and sort and match the visual feature points; S2: Take the center of mass of the target load as the coordinate origin and establish the target coordinate system Ox on the target load o y o z o , according to the visual feature points extracted in step S1, calculate the coordinate system of the target to the camera coordinate system O at different times c -x c y c z c The rotation matrix and translation vectors i=1,2,···,N; S3: By rotation matrix and translation vectors The target load center of mass is converted to the camera coordinate system, and the center of mass coordinates are used to fit the center of mass trajectory line L to obtain the translation direction n of the target load; the center of mass coordinates are projected onto the line L, and the translation speed v of the target load is calculated using the center of mass projection point; S4: By rotation matrix Obtain the rotation characteristic point P of the target load at different times i , using the rotation feature point P i Fit the target load rotation trajectory plane π; according to the perpendicular bisector constraint and the circle center coplanar constraint, fit the target load rotation trajectory circle in the plane π, and calculate the coordinate of the center C of the rotation trajectory circle; i After projecting the center C onto the plane π, the coordinates of the feature projection points and the center projection points are reduced in dimension, and the reduced-dimensional coordinates are used to calculate the rotation angle θ and rotation speed ω of the target load.
2. The method for synchronously measuring multi-parameter monocular vision of load motion in a drop tower test according to claim 1, Features: The specific operation steps of step S1 include: S101: The camera is fixed, a dot target is placed in front of the camera, the position and direction of the dot target are adjusted, 10 to 15 target images with different postures are collected using a measuring camera, and the internal parameter matrix A and the distortion coefficient vector d of the measuring camera are calibrated. S102: Calculating the center of mass position of the target load according to the structure and density information of the target load; S103: designing a cooperative marking dot array on a certain plane of the target load, and using a calibrated measurement camera to collect N frames of measurement images including the cooperative marking dot array when the target load moves; S104: extracting the ellipse corresponding to the cooperative marking point in the measurement image, and calculating the coordinates of the common tangent point of the ellipse as the measurement feature point of the target load; S105: sorting the extracted feature points in each frame image, and matching the feature points in different frame images according to the sorting result.
3. The method for synchronously measuring multi-parameter monocular vision of load motion in a drop tower test according to claim 1, Features: The specific operation steps of step S3 include: S301: According to the rotation matrix and translation vectors The target load mass center O at different times i Coordinates are converted to camera coordinates S302: Using the centroid point O at different times i Fit the space straight line L and obtain the direction vector n of the straight line L in the camera coordinate system, then the translation direction of the target load is n; S303: The centroid points O at different times i Project it onto the line L and get the projection point The coordinate vector is Through the projection point The translation velocity v of the target load is calculated by using the coordinates and time difference: Where ΔT represents the time interval between adjacent frames of the measurement camera, and m and n represent the number of frames.
4. The method for synchronously measuring multi-parameter monocular vision of load motion in a drop tower test according to claim 1, Features: The specific operation steps of step S4 include: S401: According to the rotation matrix Set the target coordinate system O of the i-th frame i -x o,i y o,i z o,i The unit reference vector under Convert the unit vector to the camera coordinate system Vector The end point of the rotation feature point P i , construct the rotation feature point set S = {P i |i=1,2,···,N}; S402: Let the set S ′ =S, use set S ′ Fit the equation of plane π and calculate P i The distance d to the plane π i ,like Make d i >d 0 , then from the set S ′ Eliminate P i , and refit the plane until it satisfies d i ≤d 0 ; S403: According to the perpendicular bisector constraint and the circle center coplanar constraint, a spatial circle fitting optimization function is constructed, and the extreme value points of the optimization function are calculated to obtain the three-dimensional coordinates of the center C of the fitting circle trajectory and the linear equation of the self-rotation axis, where the perpendicular bisector constraint is defined as the set S ′ The perpendicular bisector of the line connecting any two points in the circle must pass through the center of the circle; the center coplanarity constraint is defined as the center of the circle being within the fitting plane π; S404: Project the set S and the center C onto the plane π to obtain the set S π and the center C π , establish the plane coordinate system O in plane π d -x d y d , the set S π and the center C π Perform coordinate dimensionality reduction to obtain its d -x d y d Two-dimensional coordinates in the coordinate system and X C,d , the rotation angle θ and rotation angular velocity ω of the target load are calculated by the following formula:
Citation Information
Cited By
XCP probe spinning speed video measurement device and method
CN119395321A
A XCP probe spin speed video measurement device and method
CN119395321B
