A non-contact wave measurement method based on shape recovery from light and shadow

Through the light and dark shape recovery method and drone aerial photography technology, the problem of high measurement error and cost in contactless wave measurement is solved, real-time wave measurement and parameter calculation in large areas of sea areas are realized, and the accuracy and reliability of measurement are improved. .

CN118565448BActive Publication Date: 2024-11-12SANYA SCI & EDUCATION INNOVATION PARK WUHAN UNIV OF TECH +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411060574.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-05
Publication Date
2024-11-12
Estimated Expiration
2044-08-05

AI Technical Summary

Technical Problem

The existing non-contact wave measurement technology has problems such as rainfall and wave breaking interference, large measurement errors, high costs, and inability to meet the real-time observation needs of large areas of sea areas.

Method used

Using non-contact wave measurement method based on light and dark recovery shape, the hemispherical model and drone aerial photography combined with visual recognition technology can realize three-dimensional shape recovery and large-area measurement of waves. The hemispherical model is used to restore the shape of light and dark recovery method SFS and the hemispherical model and The wave surface is restored in three-dimensional shape and calculates the wave parameters.

Benefits of technology

It improves the accuracy and reliability of measurement, realizes continuous measurement of large areas of sea areas, reduces equipment maintenance costs, and meets the real-time observation needs of sea areas.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118565448B_ABST
    Figure CN118565448B_ABST
Patent Text Reader

Abstract

The invention discloses a non-contact wave measurement method based on shape recovery from shading. The method comprises the following steps: using a first camera to shoot an image of a hemispherical model placed on an offshore floating platform; using a shape recovery from shading method to restore the three-dimensional shape of the hemispherical model after identifying the edge of the hemispherical model, obtaining a height difference z1 between the highest point and the bottom edge of the hemispherical model, and taking a ratio of an actual radius #imgabs0# of the hemispherical model to z1 as a size conversion coefficient; using a second camera to shoot an actual wave surface image, controlling the height difference between the second camera and the sea level to be the same as the height difference between the first camera and the hemispherical model during shooting, performing three-dimensional shape recovery on the wave surface, calculating a relative height difference between a wave surface point and an average wave surface, multiplying the relative height difference by the size conversion coefficient, obtaining an actual height difference between the wave surface point and the average wave surface, combining the actual height difference with the three-dimensional shape of the wave surface to obtain a real three-dimensional shape of the wave surface; and calculating the wave parameters according to the real three-dimensional shape of the wave surface.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the technical field of ocean observation, and in particular to a non-contact wave measurement method based on light-dark recovery shape. Background Art

[0002] As one of the key factors affecting the safety of offshore and deepwater engineering structures, waves have a complex impact on engineering structures, which may cause local damage or even overall instability of the engineering structures. Therefore, accurate observation of wave conditions has important guiding significance for preventing potential marine disasters, monitoring marine environmental safety, and utilizing marine renewable energy.

[0003] The existing technical means of obtaining wave parameters mainly include non-contact remote sensing technology and contact buoy measurement technology. Contact measurement equipment will change the wave shape, resulting in measurement errors, and has high R&D and maintenance costs, and is difficult to deploy and recover. Non-contact wave measurement technology has gradually gained attention because it does not change the original shape of the waves and reduces equipment maintenance costs. The non-contact wave photogrammetry method can meet the accuracy requirements and realize dynamic real-time measurement of the wave surface. This method usually uses a binocular stereo camera to shoot the sea surface, and realizes three-dimensional measurement of waves through image matching and binocular ranging principles.

[0004] However, acoustic wave measurement in non-contact measurement is greatly disturbed by rainfall and wave breaking, and is easily affected by sound wave reflection. Although the radar system is non-contact, it is expensive, and due to the large wavelength of the transmitted wave, the echo noise reduction processing and Doppler frequency shift problems will affect the measurement results and resolution. In addition, the existing non-contact measurement methods can usually only achieve wave parameter measurement at fixed points. Under actual ocean observation conditions, control points are difficult to arrange, and mismatching and other problems are prone to occur, which affects the measurement accuracy and cannot meet the real-time observation needs of large areas of sea. Summary of the invention

[0005] In view of the deficiencies of the above-mentioned prior art, the present invention proposes a non-contact wave measurement method based on light-shading recovery shape, which realizes large-area measurement and dynamic display of waves through a wave image acquisition system and visual recognition technology.

[0006] To achieve the above object, the present invention relates to a non-contact wave measurement method based on light-shading recovery shape, comprising the following steps:

[0007] Step S1: Place the hemispherical model on an offshore floating platform, and use a first drone to take an image of the hemispherical model, with the optical center of the first drone as the origin and the optical axis as the Z The axis is defined as the direction from the optical center to the hemispherical model Z The positive direction of the axis;

[0008] Step S2: Use edge detection method to identify the edge of the hemispherical model, and use the shading recovery shape method SFS to perform 3D shape recovery on the hemispherical model to obtain the highest point of the hemispherical model and the bottom edge. Z Height difference in the axial direction , the actual radius of the hemisphere model and The ratio of is taken as the size transformation coefficient;

[0009] Step S3: Use a second drone to shoot the actual wavefront image. When shooting, control the height difference between the second drone and the sea level to be the same as the height difference between the first drone and the hemispherical model. Perform three-dimensional shape restoration on the wavefront to obtain the height difference between each point in the wavefront image and the average wavefront. Z The relative height difference in the axial direction is multiplied by the size transformation coefficient to obtain the actual height difference between each point in the wavefront image and the average wavefront, and the actual height difference is combined with the three-dimensional shape of the wavefront to obtain the true three-dimensional shape of the wavefront;

[0010] Step S4: Calculate the wave parameters based on the true three-dimensional shape of the wave surface.

[0011] Preferably, in step S2, performing three-dimensional shape restoration on the hemispherical model using a shading recovery shape method SFS comprises the following steps:

[0012] Step S21: Taking the optical center of the first drone as the origin and the optical axis as Z The axis is defined as the direction from the optical center to the hemispherical model Z The positive direction of the axis, the XOY plane is parallel to the image plane, and a spatial rectangular coordinate system is established. Then the points on the surface of the hemispherical model are expressed as ;

[0013] Step S22: construct an image illumination equation, convert it into a perspective SFS model with a point light source at infinity, iterate and solve it using the fast marching method FMM, and perform three-dimensional shape recovery on the surface of the hemispherical model.

[0014] Preferably, the image illumination equation in step S22 is expressed as:

[0015] ;

[0016] In the formula, For the image at point The normalized brightness at ; is the point on the surface of the hemisphere model The normal vector at ; is the point on the surface of the hemisphere model The light source direction vector at , is a constant.

[0017] Preferably, the expression of the perspective SFS model of the point light source at infinity in step S22 is:

[0018] ;

[0019] ;

[0020] ;

[0021] ;

[0022] In the formula, u , v is the coordinate of the pixel point on the image; is the focal length of the first drone.

[0023] Preferably, in step S22, the SFS model is iteratively solved using the fast marching method FMM, comprising the following steps:

[0024] Step S221: Take the bottom edge point of the hemispherical model as the source point and set the initial height of the source point to ,in is the vertical height difference between the image plane of the first UAV and the plane where the hemispherical model is located;

[0025] Step S222: , rewrite the SFS model into iterative form:

[0026] ;

[0027] ;

[0028] ;

[0029] ;

[0030] ;

[0031] ;

[0032] ;

[0033] ;

[0034] ;

[0035] ;

[0036] in, ; , , , is the number of iterations;

[0037] Step S223: Use the fast marching method FMM to iteratively solve the SFS model to obtain the value:

[0038] ;

[0039] In the formula, , For the Iteration midpoint exist Direction and The height value of the point with the smaller height among the two adjacent points in the direction whose height has been updated;

[0040] Step S224: Calculate each point , and get the relative height value of each point.

[0041] Preferably, step S3 calculates the height of the average wave surface h The following steps are involved:

[0042] Step S31: All pixels in the wavefront image are sorted according to their height values. Arrange in a one-dimensional array from large to small ;

[0043] Step S32: The arithmetic mean of the first 500 elements is taken as the peak height , the arithmetic mean of the last 500 elements is taken as the trough height ;

[0044] Step S33: Set the average wave height .

[0045] Preferably, in step S3 Z Reverse the axis to get Axis, establish the world coordinate system with the optical center of the drone as the origin , calculate the value of each point in the wavefront image in the world coordinate system , Coordinates, get the real three-dimensional shape of the wave surface, each point in the wave surface image in the world coordinate system , The coordinates are expressed as:

[0046] ;

[0047] ;

[0048] ;

[0049] In the formula, is the point in the wavefront image The coordinate values ​​of the axis; is the size transformation coefficient; is the point in the wavefront image Z The coordinate values ​​of the axis; u , v is the coordinate of the pixel point on the wavefront image; F is the focal length of the second drone.

[0050] Preferably, step S4 comprises the following steps:

[0051] Step S41: extracting the height information of a fixed pixel point changing with time from the three-dimensional reconstruction result of the wave surface to form a time course curve of the pixel point;

[0052] Step S42: Calculate the average wave height of the wave according to the positions of the wave crests and wave troughs in the time history curve, and calculate the average wave period according to the time interval between adjacent wave crests in the time history curve;

[0053] Step S43: Identify the crest line in the three-dimensionally reconstructed wave surface, measure the distance between adjacent crests in the crest line to obtain the wavelength of the wave, and determine the direction of the wave by analyzing the direction of the crest line.

[0054] Preferably, the expression of the average wave height in step S42 is:

[0055] ;

[0056] The expression of the average period is:

[0057] ;

[0058] In the above formula, is the average wave height; is the average period; is the total number of peaks in the time history curve; , They are the first The water surface height corresponding to the peak and trough of each wave; The time history curve The moment corresponding to the peak of a wave.

[0059] Preferably, the method of identifying the crest line in the three-dimensionally reconstructed wave surface in step S43 comprises the following steps:

[0060] Step S431: Project all points on the three-dimensionally reconstructed wave surface vertically onto the horizontal plane to obtain OK, List the two-dimensional coordinate points and Z Reverse the axis to get Axis, corresponding to all points on the wave surface Axis coordinate value Extract it to form a Two-dimensional array of ;

[0061] Step S432: Set constraints and obtain The maximum point set of each row of elements in , Indicates that each row in a two-dimensional array A collection of maximum values, connected The two-dimensional coordinate points corresponding to the points in The expression of the constraint condition is:

[0062] ;

[0063] In the formula, is the first The first A maximum value.

[0064] The benefits of the present invention include at least:

[0065] 1. Using the hemispherical model as a reference for preliminary calibration improves the accuracy and reliability of the measurement. The three-dimensional shape of the hemispherical model and the actual wave surface is restored by the shading recovery shape method SFS, which can accurately obtain the height information of the object surface, from which multiple parameters of the wave can be obtained;

[0066] 2. Use drones for aerial photography. The same device can record wave information at several different locations at the same time, which can achieve continuous measurement of large areas of sea, not just fixed points. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] Figure 1 A layout diagram of a test site according to an embodiment of the present invention;

[0068] Figure 2 A schematic diagram of a method flow of an embodiment of the present invention;

[0069] Figure 3 A schematic diagram of SFS coordinate definition according to an embodiment of the present invention;

[0070] Figure 4 A schematic diagram of shooting position relationship according to an embodiment of the present invention;

[0071] Figure 5 This is a perspective SFS model diagram of a point light source located at infinity according to an embodiment of the present invention;

[0072] Figure 6 This is a schematic diagram of the principle of photographing wavefronts by a camera according to an embodiment of the present invention;

[0073] Figure 7 A schematic diagram of coordinate value conversion according to an embodiment of the present invention;

[0074] Figure 8 A schematic diagram of wavelength calculation according to an embodiment of the present invention;

[0075] Fig. 9 A wavelength decomposition schematic diagram of an embodiment of the present invention;

[0076] Fig.10 3D wavefront reconstruction flowchart according to an embodiment of the present invention.

[0077] In the figure, 1-wave image collector; 2-support frame; 3-test water tank; 4-light source; 5-ruler; 6-ruler image collector; 7-tripstand; 8-wave height meter; 9-stainless steel long rod; 10-wave maker; 11-energy dissipation device; 12-control console; 13-counterweight. DETAILED DESCRIPTION

[0078] The following is a clear and complete description of the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work belong to the protection scope of the present invention.

[0079] Embodiment 1

[0080] In order to better perform non-contact wave measurement in an actual marine environment, the embodiment of the present invention first builds a non-contact wave measurement device indoors for experimental research on related hydrodynamics.

[0081] like Figure 1 As shown, an embodiment of the present invention provides an indoor non-contact wave measuring device, including: a wave-making device, a wave image collector 1, a support frame 2, a light source 4, a ruler 5, a ruler image collector 6, a tripod 7, a wave height meter 8, a stainless steel long rod 9 and a counterweight 13.

[0082] The wave-making device includes a test water tank 3, a wave maker 10, an energy dissipation device 11 and a control console 12, and is used to generate specific regular waves, solitary waves and other forms of waves in the test room.

[0083] The wave height meter 8 is used to monitor the wave height change in real time. The two wave height meters in the device are arranged at intervals along the flow direction in the water tank.

[0084] The light source 4 is a surface light source, which is used to simulate the parallel rays of sunlight shining on the wave surface.

[0085] The ruler 5 is attached to the side wall of the water tank and is used to record the actual wavelength of the waves.

[0086] The scale image collector 6 is used to capture a scale image reflecting actual wavelength information.

[0087] The support frame 2 is used to set up equipment such as light sources and wave image collectors.

[0088] The tripod 7 is used to set up the scale image collector.

[0089] The wave image collector 1 is connected to the support frame 2, and the posture of the wave image collector 1 is adjusted through the support frame 2 so that the optical axis of the wave image collector 1 is perpendicular to the calm wave surface, the long axis of the collected image is parallel to the wave flow of the test water tank 3, and the distance between the wave image collector 1 and the calm wave surface is set to a fixed height. The wave image collector 1 is connected to the mobile phone to realize remote shooting control; the light source 4 is connected to another support frame, and the angle of the light source 4 is adjusted to make it project toward the water surface; the ruler 5 is attached to the side wall of the test water tank 3, the ruler image collector 6 is connected to the tripod 7, and is placed on the side of the test water tank 3 where the ruler is not attached, so that the entire ruler 5 and the wave surface can be photographed; the wave height meter 8 is connected and fixed to the stainless steel long rod 9, the spacing is set to half the test wavelength, and it is ensured that the two wave height meters are within the range of wave image acquisition.

[0090] After the device is built, it is connected to an image processing module, which is used to filter, correct, remove highlights, and perform three-dimensional reconstruction using the SFS method on the images collected by the wave image collector 1, and calculate wave parameters based on the results of the three-dimensional reconstruction.

[0091] like Figure 2 As shown, the present invention provides a non-contact wave measurement method based on light-dark recovery shape, comprising the following steps:

[0092] Step S1: Place the hemispherical model on an offshore floating platform and use a first camera to capture an image of the hemispherical model, with the optical center of the first camera as the origin and the optical axis as the Z The axis is defined as the direction from the optical center to the hemispherical model Z The positive direction of the axis.

[0093] Specifically, the camera that shoots the wavefront is first calibrated using the Zhang Zhengyou calibration method. The grid calibration plate is photographed in different positions by shooting videos. The video is then decomposed into pictures by frame, and 25 pictures are randomly selected for calibration. The relevant parameters are calculated based on the transformation relationship between the spatial coordinates of each grid corner point in the world coordinate system and the coordinates of the corresponding image pixel point.

[0094] Step S2: Use edge detection method to identify the edge of the hemispherical model, and use the shading recovery shape method SFS to perform 3D shape recovery on the hemispherical model to obtain the highest point of the hemispherical model and the bottom edge. Z Height difference in the axial direction , the actual radius of the hemisphere model and The ratio of is taken as the size transformation coefficient.

[0095] The hemispherical model is placed on a platform at a certain height above the horizontal plane, the lighting equipment in the laboratory is turned off, the light source is turned on, and the wave image collector is controlled by the mobile phone to collect images of the hemispherical model. After the captured video is decomposed into pictures by frame, a picture with good imaging quality is selected, and the hemispherical picture is preprocessed by grayscale, highlight removal, filtering and denoising, etc. The area around the hemisphere is intercepted, and the Hough gradient method in the Opencv vision library is used to detect the circular edge in the image to identify the edge of the hemisphere.

[0096] like Figure 3 As shown, it is assumed that the origin of the camera coordinate system is the optical center of the camera, and the optical axis of the camera is used as the coordinate system. Z axis, and the direction in which the optical center points to the surface of the object is taken as Z The positive direction of the axis, X , Y Axis and image u , v The axes are parallel to each other and a spatial rectangular coordinate system is established. The surface function of an object in the camera coordinate system is defined as , the coordinates of a point on the surface are , assuming that the surface point corresponds to a point in the two-dimensional image , Represents image points brightness.

[0097] like Figure 4 As shown, the edge point at the bottom of the hemisphere model is used as the source point, and the initial height of the source point is Assigned to ,in is the vertical height difference between the camera image plane and the object plane, is the focal length of the camera, which is 24.03 mm according to the camera calibration result. Then the image illumination equation is solved using the perspective SFS method with a point light source at infinity, and the three-dimensional shape of the hemispherical surface is restored. After processing, the hemispherical surface can be obtained. In the coordinate system, the radius of the sphere is The dimensionless length in the direction, that is, the highest point of the hemispherical model corresponds to The value corresponds to the edge point at the bottom of the hemisphere model The difference between the values ​​is recorded as According to the actual size of the hemisphere, we can get Conversion factor between dimensionless length in a direction and actual size .

[0098] The expression of the image illumination equation is:

[0099] ;

[0100] In the formula, is the image point The normalized brightness at ; , represents the surface point of the object The normal vector at ; Points on the surface of the object The light source direction vector at Represents the inner product operation.

[0101] If the light is parallel to the surface of the object, the light source vector can be set to a constant vector ,in, , are all constants.

[0102] Then the image illumination equation can also be expressed as:

[0103] .

[0104] When the distance between the point light source and the surface of an object is infinite, the light irradiating the surface of the object can be approximated as parallel light. Since the distance between the sun and the earth is much greater than the radius of the earth itself, for the sea surface on the earth, the sun can be regarded as a point light source at infinity. Therefore, the present invention is based on the perspective SFS model in which the point light source is located at infinity, see Figure 5 .

[0105] Assume that the light source vector is a constant vector , the camera focal length is , according to the principle of similar triangles, there is a relationship under perspective projection:

[0106] , .

[0107] Substituting into the image illumination equation, the perspective SFS model of the point light source at infinity can be deduced as:

[0108] ;

[0109] in, , , .

[0110] set up , , , , then the equation can be rewritten as:

[0111]

[0112] Where:

[0113] ;

[0114] ;

[0115] ;

[0116] ;

[0117] ;

[0118] ;

[0119] ;

[0120] ;

[0121] ;

[0122] Writing this as an iterative form:

[0123]

[0124] in is the number of iterations.

[0125] The above iterative form of the equation is called the generalized Eikonal equation, which can be solved iteratively using the fast marching method (FMM). FMM is an accelerated numerical method based on the level set method. The idea of ​​this method is to start from the source point of the two-dimensional image, usually the edge point of the object surface or the brightest point in the image, simulate the evolution of the closed motion interface over time, and solve the corresponding value of each grid point in the discretized grid by step-by-step recursion. Using this method to solve the equation in iterative form, we obtain:

[0126]

[0127] In the formula, , It is in The grid points in the iteration exist Direction and The height value of the point with the smaller height among the two adjacent grid points in the direction whose height has been updated.

[0128] After obtaining the relative height value of each grid point, establish Coordinate system, using Represents the relative height calculation result of each point in the two-dimensional image, where Represents the midpoint of a two-dimensional image The corresponding relative height value.

[0129] The algorithm flow for solving the perspective SFS model when the light source is at infinity can be simply described as: establishing the image illumination equation of the perspective SFS model according to the imaging conditions; calculating the initial height of the source point on the surface of the object Assignment, according to Get the initial value; establish the generalized Eikonal equation and use the iterative advancement method of FMM to solve each grid point Value, by Get the relative height value of each grid point.

[0130] Step S3: Use the second camera to capture the actual wavefront image. When capturing, control the height difference between the second camera and the sea level to be the same as the height difference between the first camera and the hemispherical model. Perform three-dimensional shape restoration on the wavefront to obtain the height difference between each point in the wavefront image and the average wavefront. Z The relative height difference in the axial direction is multiplied by the size transformation coefficient to obtain the actual height difference between each point in the wavefront image and the average wavefront, and the actual height difference is combined with the three-dimensional shape of the wavefront to obtain the true three-dimensional shape of the wavefront.

[0131] Once you have photographed the reference object, you can remove it. Figure 6 As shown, without changing the camera's shooting angle, move the camera horizontally above the wave surface to be measured, and at the same time lower the camera's height , so that the camera image plane and the surface The height difference is Add an appropriate amount of turbidity agent to the water tank, turn on the wave-making system to stir the water to make it turbid, so as to simulate the actual light transmittance of the sea surface.

[0132] The wave-making parameters are preset to start wave-making. The scale image collector, wave image collector, and wave height meter equipment are synchronously collected to obtain wave images and wave height meter data in the target area. The wave surface video captured by the camera is decomposed into frames, and the image is corrected after being output as a picture sequence to obtain the RGB image of the water tank wave surface. The RGB color image is removed from the image using the existing highlight removal model, and then converted into a grayscale image, and the image is subjected to denoising by using a median filter.

[0133] Take the brightest point in the image as the source point and calculate the initial height of the source point Assigned to , the perspective SFS method is used to restore the three-dimensional shape of the wave surface, and the relative height corresponding to each point in the two-dimensional wave surface image can be obtained. .

[0134] In fact, the brightest point in the wavefront image is not necessarily located at the surface. Therefore, the source point is directly assigned It may not match the actual value and needs further correction. Assume that there are image points, and the height values ​​corresponding to these points Arrange them into a one-dimensional array in descending order . Remember the one-dimensional array The arithmetic mean of the first 100 elements in is , represents the peak height, array The arithmetic mean of the last 100 elements in is , represents the trough height, let Since the waves captured in the water tank test are regular and continuous sine waves, according to the properties of sine waves, is the average wave surface height. If the average wave surface is recorded as , then face Can be approximated as a surface , therefore, the surface The vertical distance to the camera image plane can also be approximated as .

[0135] Search Image point ,but Theoretically, it will be On, with As the source point, the initial height Assigned to , use the perspective SFS method to restore the three-dimensional shape of the wave surface, that is, each wave surface point is obtained Relative height value in coordinate system .

[0136] The real three-dimensional shape of the waves is restored by the transformation coefficients obtained from the relative height values ​​and the hemispherical model experiments.

[0137] When shooting a hemispherical reference object, The distance from the camera image plane is , when photographing the wave surface, the surface The distance from the camera image plane is also , and the illumination conditions did not change when shooting the two object surfaces. Therefore, it can be considered that the reference object and the water tank wave surface are equivalent to two objects with different surface shapes, and the perspective SFS 3D shape recovery is performed in the same camera coordinate system. In addition, when using the perspective SFS method, the initial height of the source point of the reference object and the water tank wave surface is assigned the same value, and the actual vertical distances of the two source points from the camera optical center are approximately equal. Therefore, the 3D recovery results of the two object surfaces are In the coordinate system Z There is a proportional relationship in the axis direction:

[0138] ,Right now ;

[0139] In the formula, for The dimensionless length of a point on the wave surface from the average wave surface in the coordinate system, It is the actual length of a certain point on the wave surface from the average wave surface.

[0140] To match the general height description in the real world, In the coordinate system Z Reverse the axis to get axis, The value of Times. Figure 7 As shown, the world coordinate system is established with the camera optical center as the origin , then each point on the wave surface is in the world coordinate system , The coordinates can be found using the principle of similar triangles:

[0141] ;

[0142] ;

[0143] ;

[0144] In the formula, The wave surface point is The coordinate value under the axis; according to the coordinates of each wave surface point in the world coordinate system, the real three-dimensional size of the wave surface can be obtained.

[0145] Step S4: Calculate the wave parameters based on the true three-dimensional shape of the wave surface.

[0146] The height information of fixed pixel points changing with time is extracted from the three-dimensional reconstruction results of the wave surface to form a time history curve of the pixel point. The average wave height of the flume waves and its corresponding average period are measured according to the time history curve. The calculation formula is as follows:

[0147] ;

[0148] ;

[0149] In the formula, is the average wave height; is the average period; is the total number of peaks in the time history curve; , They are the first The water surface height corresponding to the peak and trough of each wave; The time history curve The moment corresponding to the peak of a wave.

[0150] Then all points on the 3D reconstructed wave surface are vertically projected onto On the plane, that is The projection point is Assuming that there are OK, List the two-dimensional coordinate points and map all the points on the space surface to Axis coordinate value Extract it to form a Two-dimensional array of , Indicates that the array Row, No. The element values ​​on the column, then the two-dimensional array Elements in and Two-dimensional coordinate points in the plane There is a corresponding relationship. Find the two-dimensional array The maximum value of each row of elements in , ,in, Represents a two-dimensional array No. A maximum value.

[0151] The wave surface after 3D reconstruction is not very smooth, and there may be small protrusions or small grooves locally. Elements of a row in It may not have a simple increasing or decreasing rule, and some constraints need to be set according to the actual situation to obtain the local maximum value. The constraints are set as follows:

[0152] ;

[0153] When the above formula is established, it is considered that For the The first A maximum value. or , the point is considered to be at the edge of the image and is ignored.

[0154] make , Indicates that each row in a two-dimensional array A set of maxima. Find The two-dimensional coordinate points corresponding to each element in the equation are connected to obtain the first Wave crest line .

[0155] like Figure 8 As shown in the figure, we take the case where there are two peaks and one trough in the image at a certain moment as an example. midpoint , at the crest line Take from above Points , … (Here is taken ),satisfy ( ). Calculate the moment Distance :

[0156] ;

[0157] Find Minimum value of According to the definition of wavelength, this value is the wavelength between two adjacent peaks at that moment. ,Right now .

[0158] The average wavelength over a period of time for:

[0159] ;

[0160] In the formula is the total number of sample images within a period of time.

[0161] Assumptions hour, Get the minimum value , remember this time The point coordinates are , The point coordinates are , if the image is taken The positive direction of the axis is taken as 0° due north, then Time wavelength Component in the east-west direction and wavelength Component in the north-south direction It can be expressed as:

[0162] .

[0163] like Fig. 9 As shown in the figure, with the counterclockwise direction as the positive azimuth, the average wave direction of the wave over a period of time is It can be found based on the general direction of wave movement:

[0164] ;

[0165] ;

[0166] ;

[0167] In the formula, is the average wave direction; is the total number of sample images; The wavelength The average component in the east-west direction; The wavelength The average component in the north-south direction.

[0168] Embodiment 2

[0169] The embodiment of the present invention replaces the wave image collector in the indoor non-contact wave measurement device with a drone from a camera, and provides a non-contact wave measurement method that can be used for outdoor actual waves. Fig.10 shown.

[0170] The present invention proposes a non-contact wave measurement method based on the shape-from-shading method, which uses a monocular camera to shoot the waves in the water tank, processes the wave image based on the perspective SFS method with a point light source at infinity to invert the basic information of the waves, performs three-dimensional restoration of the wave surface shape, and calculates the size conversion coefficient by introducing a reference object, thereby obtaining the actual three-dimensional size of the wave surface; according to the wave surface shooting video obtained by the monocular camera, the time series image of the wave surface is obtained by frame decomposition, and the average wave height, average period, average wavelength and average wave direction of the wave are calculated in combination with the three-dimensional reconstruction result of the water tank wave surface obtained by the SFS method. Compared with the existing shape-from-shading method, the present invention regards the sun as a point light source model at infinity and combines it with the perspective SFS, which is more in line with the camera imaging process in the actual real world; introduces the size conversion coefficient to make up for the problem that the traditional SFS method can only obtain relative height. Compared with the general photographic wave measurement method, the wave measurement method of the present invention can obtain more wave parameters and does not require a cumbersome outdoor calibration process; with the continuous development of drone aerial photography remote sensing technology, the wave measurement method proposed by the present invention also provides a reference for realizing drone aerial photography and real-time measurement of sea surface waves.

[0171] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. Only the preferred embodiments of the present invention are expressed. The description is more specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. As long as there is no contradiction in the combination of these technical features, they should be considered as the scope recorded in this specification.

[0172] It should be noted that, for those skilled in the art, several modifications and improvements can be made without departing from the concept of the present invention, and these modifications and improvements all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. A non-contact wave measurement method based on light-shading recovery shape, characterized in that: The following steps are involved: Step S1: placing the hemispherical model on an offshore floating platform, using a first drone to take an image of the hemispherical model, taking the optical center of the first drone as the origin and the optical axis as the Z axis, and defining the direction from the optical center to the hemispherical model as the positive direction of the Z axis; Step S2: using an edge detection method to identify the edge of the hemispherical model, using the shading recovery shape method SFS to perform 3D shape recovery on the hemispherical model, obtaining the height difference z1 between the highest point and the bottom edge of the hemispherical model in the Z-axis direction, and taking the ratio of the actual radius R of the hemispherical model to z1 as the size transformation coefficient of the hemispherical model; The three-dimensional shape recovery of the hemispherical model using the shading recovery shape method SFS includes the following steps: Step S21: Make the XOY plane parallel to the image plane and establish a spatial rectangular coordinate system, then the points on the surface of the hemispherical model are represented as (x, y, z); Step S22: construct an image illumination equation, convert it into a perspective SFS model with a point light source at infinity, iterate and solve it using the fast marching method FMM, and perform three-dimensional shape recovery on the surface of the hemispherical model; The expression of the image illumination equation is: Where I(u,v) is the normalized brightness of the image at point (u,v); (p,q,-1) is the normal vector at point (x,y,z) on the surface of the hemispherical model; (p L ,q L ,-1) is the light source direction vector at the point (x,y,z) on the surface of the hemispherical model, p L ,q L is a constant; The expression of the perspective SFS model when the point light source is located at infinity is: Where u and v are the coordinates of the pixel points on the image; F is the focal length of the first UAV; The iterative solution using the fast marching method FMM comprises the following steps: Step S221: taking the bottom edge point of the hemispherical model as the source point, setting the initial height of the source point to H0=HF, where H is the vertical height difference between the image plane of the first drone and the plane where the hemispherical model is located; Step S222: Let z (0) =H0=HF, rewrite the SFS model into iterative form: a1(φ u (k+1) ) 2 +b1(φ v (k+1) ) 2 =f (k) (f u (k) ,f v (k) ); a1=I 2 L 2 (you 2 +F 2 ); b1=I 2 L 2 (in 2 +F 2 ); f(φ u ,f v )=a2φ u 2 +b2φ v 2 -2cφ u f v -2dφ u -2eφ v -g; a2=(u-Fp L ) 2 ; b2=(v-Fq L ) 2 ; c=I 2 L 2 uv-(u-Fp L )(v-Fq L ); d=I 2 L 2 u-(u-Fp L ); e=I 2 L 2 v-(v-Fq L ); g=I 2 L 2 -1; Among them, I=I(u,v);φ=lnz, k is the number of iterations; Step S223: Use the fast marching method FMM to iteratively solve the SFS model to obtain the φ value of each point on the hemispherical model: Where φ1 and φ2 are the height values ​​of the points whose heights have been updated and whose heights are smaller among the two adjacent points in the x-direction and y-direction of the point (i, j) in the k+1th iteration; Step S224: Calculate z=e for each point φ , and obtain the relative height value of each point; step S3: use the second drone to shoot the actual wavefront image, and when shooting, control the height difference between the second drone and the sea level to be the same as the height difference between the first drone and the hemispherical model, perform three-dimensional shape recovery on the wavefront, and obtain the relative height difference between each point in the wavefront image and the average wavefront in the Z-axis direction, multiply the relative height difference by the size transformation coefficient, and obtain the actual height difference between each point in the wavefront image and the average wavefront, and combine the actual height difference with the three-dimensional shape of the wavefront to obtain the true three-dimensional shape of the wavefront; Step S4: Calculate the wave parameters based on the true three-dimensional shape of the wave surface.

2. The non-contact wave measurement method based on light-shading recovery shape according to claim 1 is characterized in that: Step S3 calculates the height h of the average wave surface and comprises the following steps: Step S31: Arrange all the pixels in the wavefront image in descending order of height values ​​z(u,v) into a one-dimensional array {z k }; Step S32: k The arithmetic mean of the first 500 elements in} is taken as the peak height z p , the arithmetic mean of the last 500 elements is taken as the trough height z q ; Step S33: Let the average wave height h=(z p +z q ) / 2.

3. The non-contact wave measurement method based on light-shading recovery shape according to claim 1 is characterized in that: In step S3, the Z axis is reversed to obtain Z w Axis, establish the world coordinate system O with the optical center of the drone as the origin w -X w Y w Z w , calculate the X and Y coordinates of each point in the wavefront image in the world coordinate system, and obtain the true three-dimensional shape of the wavefront. The X and Y coordinates of each point in the wavefront image in the world coordinate system are expressed as: from′=K zt ·With; Where z′ is the point in the wavefront image at Z w Axis coordinate value; K zt is the size transformation coefficient; z is the coordinate value of the point in the wavefront image on the Z axis; u and v are the coordinates of the pixel points on the wavefront image; F is the focal length of the second UAV.

4. The non-contact wave measurement method based on light-shading recovery shape according to claim 1 is characterized in that: Step S4 includes the following steps: Step S41: extracting the height information of a fixed pixel point changing with time from the three-dimensional reconstruction result of the wave surface to form a time course curve of the pixel point; Step S42: Calculate the average wave height of the wave according to the positions of the wave crests and wave troughs in the time history curve, and calculate the average wave period according to the time interval between adjacent wave crests in the time history curve; Step S43: Identify the crest line in the three-dimensionally reconstructed wave surface, measure the distance between adjacent crests in the crest line to obtain the wavelength of the wave, and determine the direction of the wave by analyzing the direction of the crest line.

5. The non-contact wave measurement method based on light-shading recovery shape according to claim 4 is characterized in that: The expression of the average wave height in step S42 is: The expression of the average period is: In the above formula, is the average wave height; is the average period; n is the total number of peaks in the time history curve; H i 、h i are the water surface heights corresponding to the peak and trough of the i-th wave in the time history curve; t i is the time corresponding to the peak of the i-th wave in the time history curve.

6. The non-contact wave measurement method based on light-shading recovery shape according to claim 4 is characterized in that: The method for identifying the crest line in the three-dimensionally reconstructed wave surface in step S43 comprises the following steps: Step S431: Project all points on the three-dimensional reconstructed wave surface vertically onto the horizontal plane to obtain m rows and n columns of two-dimensional coordinate points, and reverse the Z axis to obtain Z w Axis, the Z corresponding to all points on the wave surface w Axis coordinate value z i,j Extract it to form a two-dimensional array z[m,n] of size m×n; Step S432: Set constraints to obtain the maximum point set of each row of elements in z[m,n], and let {z (p) } represents the set of the pth maximum value in each row of the two-dimensional array, connecting {z (p) }, and the pth wave crest line is obtained. The constraint condition is expressed as: In the formula, z i,j is the jth maximum value in the i-th row of the two-dimensional array.

Citation Information

Patent Citations

  • Wave video measuring device and method

    CN110473260A

  • Method for measuring wave climb based on airborne image

    CN114820485A

  • KR20230001875A

  • KR20230084816A