Non-contact detection method for wing deformation test based on stereoscopic vision

By arranging feature points on the wing surface and using high-speed cameras for three-dimensional reconstruction, the high cost, wear and accuracy problems of traditional contact detection methods are solved, and high-precision non-contact detection of wing deformation is achieved, which is suitable for different types of machines wings, improve the versatility and applicability of detection.

CN118913127AInactive Publication Date: 2024-11-08ZHIKONG CLOUD DETECTION TECH (HEBEI) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411090442.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-09
Publication Date
2024-11-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

There are problems in existing wing deformation tests such as high cost, wear, low measurement accuracy, slow measurement speed and installation difficulty. Especially for flexible wings, traditional contact detection methods cannot meet the requirements of accurate monitoring.

Method used

Using a non-contact detection method based on stereo vision, the wing surface is arranged with high contrast feature points, image capture and three-dimensional reconstruction is used for high-speed cameras, and the three-dimensional coordinates and deformation parameters of the feature points are calculated to achieve high accuracy of wing deformation. Test.

Benefits of technology

It realizes non-contact detection of wing deformation, provides high-precision deformation monitoring results, avoids structural damage, can monitor deformation in real time, and obtains three-dimensional models, improving the universality and applicability of the detection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118913127A_ABST
    Figure CN118913127A_ABST
Patent Text Reader

Abstract

The invention relates to a non-contact detection method for a wing deformation test based on stereoscopic vision, which is particularly suitable for an unmanned aerial vehicle detection technology. According to the method, high-contrast feature points are arranged or pasted on the surface of the wing, and at least two high-speed cameras are used for covering the whole wing area to capture the feature points. Through precise internal and external parameter calibration and synchronous triggering of the high-speed camera, images with consistent timestamps are obtained. And then image preprocessing is carried out, same feature points in different visual angles are tracked and matched, coordinates of the feature points in a three-dimensional space are calculated, and a three-dimensional model of the wing surface is reconstructed. And the deformation quantity and deformation parameters of the wing are calculated by comparing the three-dimensional models before and after stress, so that a deformation result is obtained. The method overcomes the defects of high cost, abrasion problem, low measurement speed and the like of the traditional contact measurement method, and provides an efficient and accurate non-contact detection means for wing deformation test.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the technical field of unmanned aerial vehicles, and in particular to a non-contact detection method for a wing deformation test based on stereoscopic vision. Background Art

[0002] As one of the important parts of an aircraft, the wing has the function of adjusting its attitude during flight. By changing the shape of the wing, the working efficiency of the wing can be effectively improved. Especially for variable-camber wings, their deformation is more complex and critical than that of traditional fixed-wing aircraft. In recent years, with the rapid development of compliant mechanism technology, the trend of traditional mechanical mechanisms turning into simple and robust deformation devices is obvious, which provides new opportunities for the research and development of variable-camber wings.

[0003] However, there are still some challenges and shortcomings in the existing wing deformation tests, which are mainly manifested in the following aspects: 1. Cost issue: Contact measurement usually requires the use of special fixtures to determine the measurement reference point, which will lead to higher measurement costs. Different fixtures may be required for products of different shapes, which greatly increases the cost.

[0004] 2. Wear problem: The spherical probe used in contact measurement is prone to wear due to contact force. In order to maintain a certain accuracy, the diameter of the probe needs to be calibrated regularly.

[0005] 3. The measurement method is not accurate: Although the currently commonly used contact measurement method can obtain the deformation of each point on the wing skin, frequent contact will lead to a decrease in measurement accuracy and low measurement efficiency, which cannot meet the needs of accurate monitoring of wing deformation.

[0006] 4. Measurement speed issue: Contact trigger probes usually measure in a point-by-point in-and-out manner, which means the measurement speed is slow.

[0007] 5. Three-dimensional surface measurement error: For the measurement of three-dimensional surfaces, the traditional contact trigger probe is the sensing element, and the measured point is the center position of the probe. Therefore, the probe radius needs to be compensated, which may lead to correction error problems.

[0008] In addition to the above, the application of contact detection method in wing deformation measurement is limited by many factors. Contact sensors need to be installed on the wings, which may encounter installation difficulties on the wings, especially for flexible wings, which have very strict weight restrictions. Too many sensors may affect the performance of the wings.

[0009] Therefore, it is particularly important to develop a non-contact wing deformation test method. Summary of the invention

[0010] The present invention aims to design a non-contact detection method for wing deformation test based on stereoscopic vision to solve the problems of low detection accuracy and wear of detection equipment in traditional test methods.

[0011] The present application provides a non-contact detection method for a wing deformation test based on stereoscopic vision, comprising: Step 1: Arrange or paste feature points with high contrast on the wing surface for easy identification and tracking in the image; Step 2: Select at least two high-speed cameras, and arrange the high-speed cameras to cover the entire wing surface area including all feature points according to the size and shape of the wing and the test requirements; Step 3: Accurately calibrate the internal and external parameters of each high-speed camera, where the internal parameters include focal length, principal point position, etc., and the external parameters include the position and direction of the camera in the world coordinate system; Step 4: Synchronously triggering the high-speed cameras to ensure that all the high-speed cameras capture images of the wing at the same time to obtain consistent timestamps and dynamic phases; Step 5: Acquire the frame images of the high-speed camera in different time periods, transmit the frame images to the data processing unit, and perform denoising, contrast enhancement and threshold preprocessing to improve the recognizability of feature points and reduce errors in subsequent processing; Step 6: Track and match the same feature points in different perspectives of the preprocessed frame images to obtain the feature point change curve on the wing. At the same time, based on the parallax information of the matched feature points at different perspectives, calculate the coordinates of the feature points in three-dimensional space and reconstruct the three-dimensional model of the wing surface; calculate the deformation parameters through the three-dimensional model to obtain the deformation result.

[0012] A further improvement is to set characteristic points P1, P2, P3, P4 at the flaps, flap-aileron connection, wing leading edge, and rear wing positions of the wing; and evenly set characteristic points P5, P6, P7, ... P on the surface of the wing. n-1 , P n , used to observe the wing deformation in the imaging of high-speed cameras.

[0013] Preferably, the high-speed camera selects the same feature point on the wing for shooting, and determines the Euler angle of each high-speed camera.

[0014] A further improvement is that after obtaining all the internal and external parameters of the high-speed camera according to step 3, the camera coordinates of the feature points in the image taken by the high-speed camera are obtained.

[0015] Preferably, in step 4, before the wing is subjected to a deformation test after fixation, the high-speed camera is triggered synchronously, and the first frame image taken by the camera is three-dimensionally reconstructed as an initial three-dimensional model of the wing before deformation, for comparison with the three-dimensional model after deformation.

[0016] Preferably, the step 6 includes: Generate a descriptor describing the surrounding features for each feature point P in the frame images of different time periods; Feature point descriptors are used to match frame images in adjacent time periods, find the corresponding relationship of feature points, track feature points, and obtain the deformation process curve of feature points.

[0017] A further improvement is that, in step 6, the depth information of each feature point is calculated through the disparity information of the feature point at different viewing angles; Using the depth information and internal parameters of the high-speed camera, the coordinates of each feature point in the three-dimensional space are calculated by triangulation; The 3D coordinates of all feature points are connected to form a 3D model of the wing surface.

[0018] A further improvement is to calculate the deformation amount of the wing by comparing the three-dimensional model of the wing before and after the force is applied; calculate the deformation parameters through the deformation amount and the original shape of the wing; and obtain the deformation result of the wing based on the deformation parameters.

[0019] Beneficial effects of the present application: The present application can realize non-contact detection of wing deformation by adopting feature point tracking and three-dimensional reconstruction technology, without direct contact with the wing surface, avoiding possible damage to the structure. The method based on feature point tracking and three-dimensional reconstruction can provide deformation detection results with higher accuracy, can capture subtle changes in wing surface deformation, and help to accurately analyze the deformation of the structure under different working conditions. At the same time, the feature point tracking technology can be used to realize real-time monitoring of wing deformation, and timely feedback on the deformation of the wing during operation, which is helpful to adjust the operation or prevent potential problems in time. And through three-dimensional reconstruction, a three-dimensional model of the wing surface can be obtained, which can not only provide deformation information, but also further analyze the spatial morphology and structural health status of the structure. In addition, the feature point tracking and three-dimensional reconstruction technology of the present application can be applied to different types of wings, with good versatility and applicability.

[0020] As can be seen from the above, this application combines non-contact measurement technology to achieve high-precision monitoring of wing deformation, thereby providing a more reliable basis for aircraft design and structural optimization. Such an innovative detection method will promote the development of the wing deformation test field, improve aircraft performance and safety, and has important theoretical and practical significance. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0022] Figure 1 A flow chart of the non-contact detection method provided for this application; Figure 2 This is a relationship diagram between the first camera world coordinate system and the wing world coordinate system based on this application; Figure 3 This is a relationship diagram based on the second camera world coordinate system and the wing world coordinate system. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0024] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0025] The non-contact detection method of the wing deformation test based on stereoscopic vision in the present application includes: Step 1: Arrange or paste feature points with high contrast on the wing surface for easy identification and tracking in the image. The feature points can be circular, square or other easily identifiable shapes, and the color contrasts sharply with the wing surface so that they can be easily identified in the image. For example, feature points P1, P2, P3, P4 are set at the flaps, flap aileron connection, wing leading edge, and rear wing of the wing; feature points P5, P6, P7...P are evenly set on the wing surface. n-1 , P n , used to observe the wing deformation in the imaging of high-speed cameras.

[0026] Step 2: Select at least two high-speed cameras and arrange them to cover the entire wing surface area including all feature points according to the size and shape of the wing and the test requirements. The number and position of high-speed cameras should be adjusted according to actual needs to ensure that multiple images of the same feature points can be captured.

[0027] Step 3: Accurately calibrate the internal and external parameters of each high-speed camera. In the embodiment of the present application, the distortion problem of the high-speed camera is ignored.

[0028] The internal parameters of the high-speed camera include focal length, principal point position, etc., and the external parameters include the position and direction of the camera in the world coordinate system; The Euler angle of the high-speed camera is obtained through its position, and the rotation matrix of each high-speed camera is calculated according to the Euler angle and the intrinsic parameter matrix K. The specific calculation is as follows: Assume that the Euler angles of the first high-speed camera are: α1, β1 and γ1, and α1, β1 and γ1 are the rotation angles around the X, Y and Z axes respectively; then the rotation matrix of the first high-speed camera around the X, Y and Z axes is:

[0029] in, is the rotation matrix of the first high-speed camera around the X axis, is the rotation matrix of the first high-speed camera around the Y axis, The rotation matrix of the first high-speed camera around the Z axis.

[0030] According to the above, the first high-speed camera rotates around the X axis , then rotate around the Y axis , and finally rotate around the Z axis , then the rotation matrix of the first high-speed camera is:

[0031] Similarly, assuming that the Euler angles of the second high-speed camera are α2, β2, and γ2, in the same world coordinate system, in order to ensure that the coordinate systems of the two high-speed cameras correspond to the world coordinate system with the center of the bottom of the wing near the body as the origin, the order of the three rotations of the coordinate systems of the two high-speed cameras is specified as first rotating around the X axis, then around the Y axis, and finally around the Z axis; then the rotation matrix of the second high-speed camera around the X, Y, and Z axes is:

[0032] in, is the rotation matrix of the second high-speed camera around the X axis, is the rotation matrix of the second high-speed camera around the Y axis, The rotation matrix of the second high-speed camera around the Z axis.

[0033] The rotation matrix of the second high-speed camera for:

[0034] The camera coordinates of the feature points in the camera coordinate system are calculated according to the feature point coordinates and the internal and external parameters of the high-speed camera. For each image captured by the high-speed camera, the selected feature points are extracted and matched to obtain their coordinates on the image.

[0035] The feature points can be transformed from the camera coordinate system to the three-dimensional coordinate system through the rotation matrix of each high-speed camera.

[0036] The rotation matrix of the first high-speed camera is R1, and the rotation matrix of the second high-speed camera is R2. For each feature point P i The camera coordinates can be converted from the camera coordinate system to the three-dimensional coordinate system by the following formula:

[0037] in, is the coordinate of the feature point in the world coordinate system, is the coordinate of the feature point in the camera coordinate system, R is the rotation matrix, and t is the translation vector.

[0038] Step 4: Synchronously trigger the high-speed cameras to ensure that all the high-speed cameras capture images of the wing at the same time to obtain consistent timestamps and dynamic phases. This can be achieved by hardware triggering or software synchronization.

[0039] Step 5: Acquire the frame images of the high-speed camera in time periods, transmit the frame images to the data processing unit, and perform denoising, contrast enhancement and threshold preprocessing to improve the recognizability of feature points and reduce errors in subsequent processing.

[0040] Step 6: Track and match the same feature points in different viewing angles for the preprocessed frame images at different time periods to obtain the feature point change curve on the wing. At the same time, based on the parallax information of the matched feature points at different viewing angles, calculate the coordinates of the feature points in three-dimensional space and reconstruct the three-dimensional model of the wing surface; calculate the deformation parameters through the three-dimensional model to obtain the deformation result. This step involves feature point tracking and three-dimensional reconstruction technology, which can provide high-precision deformation detection results and monitor the deformation of the wing in real time.

[0041] For each matched feature point pair, the three-dimensional space coordinates of the feature point can be calculated using the triangulation method:

[0042] Among them, R1 and R2 are the rotation matrices of the two high-speed cameras, t1 and t2 are the corresponding translation vectors, (R1 T R2) + is the pseudoinverse of the matrix product.

[0043] By adopting feature point tracking and 3D reconstruction technology, non-contact detection of wing deformation can be achieved without direct contact with the wing surface, thus avoiding possible damage to the structure. Methods based on feature point tracking and 3D reconstruction can provide deformation detection results with high accuracy, and can capture subtle changes in wing surface deformation, which helps to accurately analyze the deformation of the structure under different working conditions. At the same time, feature point tracking technology can realize real-time monitoring of wing deformation and provide timely feedback on wing deformation during operation.

[0044] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0045] The embodiments described above are only descriptions of the preferred methods of the present application, and are not intended to limit the scope of the present application. Without departing from the design spirit of the present application, various modifications and improvements made to the technical solutions of the present application by ordinary technicians in this field should fall within the protection scope determined by the claims of the present application.

Claims

1. A non-contact detection method for wing deformation test based on stereo vision, characterized in that: Step 1: Arrange or paste feature points with high contrast on the wing surface for easy identification and tracking in the image; Step 2: Select at least two high-speed cameras, and arrange the high-speed cameras to cover the entire wing surface area including all feature points according to the size and shape of the wing and the test requirements; Step 3: Accurately calibrate the internal and external parameters of each high-speed camera, where the internal parameters include focal length, principal point position, etc., and the external parameters include the position and direction of the camera in the world coordinate system; Step 4: Synchronously triggering the high-speed cameras to ensure that all the high-speed cameras capture images of the wing at the same time to obtain consistent timestamps and dynamic phases; Step 5: Acquire the frame images of the high-speed camera in different time periods, transmit the frame images to the data processing unit, and perform denoising, contrast enhancement and threshold preprocessing to improve the recognizability of feature points and reduce errors in subsequent processing; Step 6: Track and match the same feature points in different perspectives of the preprocessed frame images to obtain the feature point change curve on the wing. At the same time, based on the parallax information of the matched feature points at different perspectives, calculate the coordinates of the feature points in three-dimensional space and reconstruct the three-dimensional model of the wing surface; calculate the deformation parameters through the three-dimensional model to obtain the deformation result.

2. The non-contact detection method for wing deformation test based on stereoscopic vision according to claim 1 is characterized in that: Characteristic points P1, P2, P3, and P4 are set at the flaps, flap-aileron connection, wing leading edge, and rear wing positions of the wing; characteristic points P5, P6, P7, and P8 are evenly set on the surface of the wing. n-1 , P n , used to observe the wing deformation in the imaging of high-speed cameras.

3. The non-contact detection method for wing deformation test based on stereoscopic vision according to claim 1 is characterized in that: The high-speed camera selects a same feature point on the wing for shooting, and determines the Euler angle of each high-speed camera.

4. The non-contact detection method for wing deformation test based on stereoscopic vision according to claim 1, characterized in that: After obtaining all the internal and external parameters of the high-speed camera according to step 3, the camera coordinates of the feature points in the image taken by the high-speed camera are obtained.

5. The non-contact detection method for wing deformation test based on stereoscopic vision according to claim 1, characterized in that: In step 4, before the wing is subjected to a deformation test after fixation, the high-speed camera is synchronously triggered and the first frame image taken is three-dimensionally reconstructed as an initial three-dimensional model of the wing before deformation, for comparison with the three-dimensional model after deformation.

6. The non-contact detection method for wing deformation test based on stereoscopic vision according to claim 1, characterized in that: The step 6 includes: Generate a descriptor describing the surrounding features for each feature point P in the frame images of different time periods; Feature point descriptors are used to match frame images in adjacent time periods, find the corresponding relationship of feature points, track feature points, and obtain the deformation process curve of feature points.

7. The non-contact detection method for wing deformation test based on stereoscopic vision according to claim 6 is characterized in that: In step 6, the depth information of each feature point is calculated by using the disparity information of the feature point at different viewing angles; Using the depth information and internal parameters of the high-speed camera, the coordinates of each feature point in the three-dimensional space are calculated by triangulation; The 3D coordinates of all feature points are connected to form a 3D model of the wing surface.

8. The non-contact detection method for wing deformation test based on stereoscopic vision according to claim 7 is characterized in that: By comparing the three-dimensional models of the wing before and after the force is applied, the shape variables of the wing are calculated; The deformation parameters are calculated through the deformation amount and the original shape of the wing; According to the deformation parameters, the deformation result of the wing is obtained.