Deformation measurement method, device and equipment based on object image proportion, medium and product

Abstract

The invention provides an object image proportion-based deformation measurement method, device and equipment, a medium and a product, and the method comprises the steps: obtaining a reference image and a to-be-measured image of a target object, and enabling the reference image and the to-be-measured image to reflect the states of the target object at different moments respectively; based on the imaging focal lengths of the reference image and the to-be-measured image, object-image proportions corresponding to the reference image and the to-be-measured image are determined, and the object-image proportions of the images reflect the difference between the pixel distance in the images and the actual distance; converting the to-be-measured image and / or the reference image based on the object image proportions corresponding to the reference image and the to-be-measured image to obtain a to-be-detected image pair, the object image proportions corresponding to two images in the to-be-detected image pair being consistent; and determining the deformation of the target object at the moment corresponding to the to-be-measured image relative to the moment corresponding to the reference image based on the to-be-detected image pair. According to the invention, deformation measurement can be realized based on image comparison, and measurement without direct mechanical contact is realized.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to a deformation measurement method, device, equipment, medium and product based on object-image ratio. Background Art

[0002] Traditional deformation measurement methods mainly use mechanical measurement, which relies on physical contact sensors such as strain gauges and accelerometers to achieve measurement. Although mechanical measurement can provide relatively stable data, it requires direct mechanical contact with the object being measured, which may cause interference or damage to the object being measured. It is also difficult to measure objects that are difficult to directly contact. Summary of the invention

[0003] The present invention provides a deformation measurement method, device, equipment, medium and product based on object-image ratio, so as to solve the defect of the prior art that direct mechanical contact with the measured object is required, and realize measurement without direct mechanical contact.

[0004] The present invention provides a deformation measurement method based on object-image ratio, comprising: Acquire a reference image and an image to be measured of the target object, wherein the reference image and the image to be measured respectively reflect the states of the target object at different times; Determine the object-image ratios corresponding to the reference image and the image to be measured respectively based on the imaging focal lengths of the reference image and the image to be measured, wherein the object-image ratios of the images reflect the difference between the pixel distance in the image and the actual distance; Based on the object-image ratios respectively corresponding to the reference image and the image to be measured, the image to be measured and / or the reference image are converted to obtain an image pair to be detected, wherein the object-image ratios corresponding to the two images in the image pair to be detected are consistent; Based on the pair of images to be detected, a deformation of the target object at a time corresponding to the image to be measured relative to a time corresponding to the reference image is determined.

[0005] According to the deformation measurement method based on object-image ratio provided by the present invention, determining the object-image ratios corresponding to the reference image and the image to be measured respectively based on the imaging focal lengths of the reference image and the image to be measured includes: Obtaining the object-image ratios corresponding to the reference image and the image to be measured respectively based on a preset formula; The preset formula is: ; in, is the object-image ratio corresponding to the image, is the distance between the camera and the target object, and is the fitting coefficient corresponding to the imaging focal length of the image.

[0006] According to the deformation measurement method based on object-image ratio provided by the present invention, based on the object-image ratios respectively corresponding to the reference image and the image to be measured, the image to be measured and / or the reference image are converted to obtain an image pair to be detected, including: Obtaining a reference object-image ratio, where the reference object-image ratio is the object-image ratio corresponding to the image to be measured, the object-image ratio corresponding to the reference image, or another preset object-image ratio; Based on the reference object-image ratio and the object-image ratio of the image to be measured and / or the reference image, the image to be measured and / or the reference image are converted to obtain the image pair to be detected.

[0007] According to the deformation measurement method based on object-image ratio provided by the present invention, based on the reference object-image ratio, the object-image ratio of the image to be measured and / or the reference image, the image to be measured and / or the reference image is converted to obtain the image pair to be detected, including: Acquire a ratio of the object-image ratio of the image to be measured and / or the reference image to the reference object-image ratio; The image content of the image to be measured and / or the reference image is scaled based on the ratio to obtain an image in the pair of images to be detected.

[0008] According to the deformation measurement method based on object-image ratio provided by the present invention, the method of determining the deformation of the target object at the time corresponding to the image to be measured relative to the time corresponding to the reference image based on the image pair to be detected includes: Perform feature point detection on the two images in the image pair to be detected respectively to obtain a plurality of first feature points and a plurality of second feature points; Matching the first feature point and the second feature point to obtain a feature point pair; Determining, based on the pixel positions of the feature point pairs, the deformation of the target object at the time corresponding to the image to be measured relative to the time corresponding to the reference image; The image pair to be detected is a first image pair, a second image pair or a third image pair, the first image pair includes two of the conversion images, the second image pair includes the conversion image and the reference image, and the third image pair includes the conversion image and the image to be measured.

[0009] According to the deformation measurement method based on object-image ratio provided by the present invention, the feature point detection is performed on two images in the image pair to be detected respectively to obtain a plurality of first feature points and a plurality of second feature points, including: Inputting the images in the to-be-detected image pair into a trained feature point detection model respectively, and obtaining a feature point detection result output by the feature point detection model, wherein the feature point detection result includes the plurality of first feature points or the plurality of second feature points; Among them, the feature point detection model includes a multi-scale feature module and a fusion module. The multi-scale feature module is used to construct a feature pyramid based on the image in the image pair to be detected, and output the corresponding intermediate feature points based on each layer of feature images of the feature pyramid. The fusion module is used to output the feature point detection results of the images in the image pair to be detected based on the intermediate feature points corresponding to each layer of the feature images.

[0010] The present invention also provides a deformation measurement device based on object-image ratio, comprising: An image acquisition module, used to acquire a reference image of the target object and an image to be measured, wherein the reference image and the image to be measured respectively reflect the state of the target object at different times; An object-image ratio determination module, used to determine the object-image ratios corresponding to the reference image and the image to be measured respectively based on the imaging focal lengths of the reference image and the image to be measured, wherein the object-image ratio of the image reflects the difference between the pixel distance in the image and the actual distance; An image conversion module, configured to convert the image to be measured and / or the reference image based on the object-image ratios respectively corresponding to the reference image and the image to be measured, so as to obtain an image pair to be detected, wherein the object-image ratios corresponding to the two images in the image pair to be detected are consistent; The deformation analysis module is used to determine the deformation of the target object at a time corresponding to the image to be measured relative to a time corresponding to the reference image based on the image pair to be detected.

[0011] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the deformation measurement method based on the object-image ratio as described above is implemented.

[0012] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the deformation measurement method based on the object-image ratio as described above is implemented.

[0013] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements any of the above-mentioned deformation measurement methods based on object-image ratio.

[0014] The deformation measurement method, device, equipment, medium and product based on object-image ratio provided by the present invention obtain a reference image and an image to be measured which respectively reflect the state of the target object at different times, determine the object-image ratio based on the imaging focal lengths of the reference image and the image to be measured, and convert the reference image and the image to be measured based on the object-image ratio, so as to obtain two images with consistent object-image ratio reflecting the state of the target object at different times. Deformation measurement can be achieved based on image comparison, thereby realizing measurement without direct mechanical contact. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0016] Figure 1 It is a flow chart of a deformation measurement method based on object-image ratio provided by the present invention.

[0017] Figure 2 It is a structural schematic diagram of a deformation measurement device based on object-image ratio provided by the present invention.

[0018] Figure 3 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0020] In the prior art, deformation measurement mainly adopts mechanical measurement, that is, it relies on physical contact sensors, such as strain gauges, pressure gauges, etc. Although mechanical measurement can provide relatively stable data, it requires direct mechanical contact with the object being measured, which may cause interference or damage to the measured object itself, and it is also difficult to measure objects that are difficult to directly contact.

[0021] In order to solve the defect of the prior art that direct mechanical contact with the object to be measured is required, the present invention provides a deformation measurement method, device, equipment, medium and product based on object-image ratio to achieve measurement without direct mechanical contact.

[0022] Combine the following Figure 1 The deformation measurement method based on the object-image ratio provided by the present invention is described as follows: Figure 1 As shown, the present invention provides a deformation measurement method based on object-image ratio, comprising the steps of: S110, acquiring a reference image of the target object and an image to be measured, wherein the reference image and the image to be measured respectively reflect the states of the target object at different times; S120, determining the object-image ratios corresponding to the reference image and the image to be measured respectively based on the imaging focal lengths of the reference image and the image to be measured, wherein the object-image ratio of the image reflects the difference between the pixel distance in the image and the actual distance; S130, based on the object-image ratios respectively corresponding to the reference image and the image to be measured, converting the image to be measured and / or the reference image to obtain an image pair to be detected, wherein the object-image ratios corresponding to the two images in the image pair to be detected are consistent; S140: Determine, based on the pair of images to be detected, a deformation of the target object at a time corresponding to the image to be measured relative to a time corresponding to the reference image.

[0023] The method provided by the present invention obtains a reference image and an image to be measured that respectively reflect the states of the target object at different moments, determines the object-image ratio based on the imaging focal lengths of the reference image and the image to be measured, and converts the reference image and the image to be measured based on the object-image ratio, thereby obtaining two images with consistent object-image ratios reflecting the states of the target object at different moments. Deformation measurement can be achieved based on image comparison, thereby achieving measurement without direct mechanical contact.

[0024] The images of the object to be measured at different times can reflect the state of the object to be measured at different times. Therefore, deformation measurement can be achieved by comparing the images of the object to be measured at different times. In the method provided by the present invention, a reference image of the target object whose deformation is to be measured and the image to be measured are first obtained. The reference image and the image to be measured are images obtained by imaging the target object at different times. That is to say, the reference image and the image to be measured reflect the state of the target object at different times. Based on the image to be measured and the reference image, the deformation of the target object at the time corresponding to the image to be measured relative to the time corresponding to the reference image can be obtained.

[0025] When imaging the target object to obtain the reference image and the image to be measured, shooting can be performed at multiple angles or positions to ensure that sufficient data is obtained to cover the entire deformation measurement area. A shooting device that can shoot within a wide focal length range can be used. The configuration should include a high-stability bracket and a precise focal length adjustment mechanism to ensure shooting stability and repeatability at different focal lengths.

[0026] There is a difference between the pixel size in the image and the actual size, and this difference will also change due to different shooting focal lengths. This difference can be measured by the object-image ratio, which reflects the difference between the pixel distance in the image and the actual distance. Therefore, ideally, if the deformation measurement of the target object is performed directly based on the image to be measured and the reference image, the two images need to be shot at the same focal length. However, due to the actual situation, this same focal length shooting is often not possible. For example, the target object may be in different positions at two times, or the target object may be large in size or have high deformation requirements, and it is necessary to determine its deformation at different scales and accuracies. In these cases, imaging the target object may require imaging from multiple focal lengths to achieve better imaging effects. For example, for objects with rich details, a shorter focal length is selected, and for objects at a longer distance, a longer focal length is selected. Therefore, the image to be measured and the reference image need to be further processed to obtain two images with the same object-image ratio before deformation measurement.

[0027] In a possible implementation, before the measured image and the reference image are converted to have consistent object-image ratios, they may be preprocessed, including image cropping, contrast adjustment, and sharpening, to reduce the impact of other factors such as lighting on the image and optimize the subsequent deformation analysis process.

[0028] Specifically, based on the imaging focal lengths of the reference image and the image to be measured, determining the object-image ratios corresponding to the reference image and the image to be measured, respectively, includes: Obtaining the object-image ratios corresponding to the reference image and the image to be measured respectively based on a preset formula; The default formula is: ; in, The focal length is , the object-image ratio of the image obtained when the distance between the camera and the target object is dis, the unit is mm / pixcel, is the distance between the camera and the target object, in mm, and is the imaging focal length of the image The corresponding fitting coefficient, that is, for the same imaging focal length , and its corresponding fitting coefficient and is a fixed constant.

[0029] The fitting coefficient can be obtained through image acquisition experiments. Specifically, in the experiment, a high-resolution video camera with a variable-focus lens can be selected. The device can shoot in a wide range of focal lengths to adapt to measurement objects of different sizes and distances, and includes a high-stability bracket and a precise focal length adjustment mechanism to ensure shooting stability and repeatability at different focal lengths. The video camera is connected to a computer system, and the shooting parameters are controlled by dedicated software, and image data is transmitted.

[0030] In the experimental preparation stage, select the shooting object. You can choose a black and white checkerboard calibration plate of known specifications as the shooting object, so that you can choose the corner points of the calibration plate to count the pixel distance, which is more accurate. Set the camera focal length that needs to determine the corresponding fitting coefficient, shoot the shooting object at different distances to obtain multiple images (for example, five images) and ensure that the black and white checkerboard calibration plate appears completely in the camera field of view, and use a laser rangefinder to measure and record the distance between the camera and the center of the calibration plate. For each image obtained by shooting, randomly extract the corner points of the calibration plate pattern to form a point pair, and record the pixel coordinates of the point pair (for example, randomly extract 10 groups), and calculate the average value of the ratio of the object spacing of multiple corresponding corner points to the pixel spacing. Take the average value and the distance value measured by the laser rangefinder as independent variables, and use the least squares method to fit the fitting coefficient in the preset formula. For the fitting coefficients corresponding to other focal length values, similar steps can be used to obtain them.

[0031] Through the preset formula in the method provided by the present invention, the object-image ratios corresponding to the reference image and the image to be measured can be calculated, so that the reference image and / or the image to be measured are converted to obtain an image pair to be detected, wherein the image pair to be detected includes two images with the same object-image ratio, thereby realizing automatic adjustment and conversion of images at different focal lengths to ensure the consistency and comparability of the data, thereby ensuring the accuracy of the image-based measurement results.

[0032] Based on the object-image ratios corresponding to the reference image and the image to be measured, respectively, the image to be measured and / or the reference image are converted to obtain an image pair to be detected, including: Obtaining a reference object-image ratio, where the reference object-image ratio is the object-image ratio corresponding to the image to be measured, the object-image ratio corresponding to the reference image, or another preset object-image ratio; Based on the reference object-image ratio and the object-image ratio of the image to be measured and / or the reference image, the image to be measured and / or the reference image is converted to obtain an image pair to be detected.

[0033] The reference object-image ratio may be the object-image ratio corresponding to the image to be measured, the object-image ratio corresponding to the reference image, or other preset object-image ratios. In practical applications, the object-image ratio corresponding to the reference image is used as the reference object-image ratio to improve conversion efficiency.

[0034] Based on the reference object-image ratio and the object-image ratio of the image to be measured and / or the reference image, the image to be measured and / or the reference image is converted to obtain an image pair to be detected, including: Obtaining a ratio of the object-image ratio of the image to be measured and / or the reference image to the reference object-image ratio; The image content of the image to be measured and / or the reference image is scaled based on the ratio to obtain an image in the image pair to be detected.

[0035] When the reference object-image ratio is the object-image ratio of the image to be measured or the reference image, it is only necessary to convert the image without the reference object-image ratio, that is, when the reference object-image ratio is the object-image ratio of the reference image, it is only necessary to convert the image to be measured. At this time, the image in the image pair to be detected is the reference image and the image obtained after converting the image to be measured.

[0036] Specifically, when the image to be measured or the reference image is converted, the ratio of the corresponding object-image ratio to the reference object-image ratio is obtained, and the image to be measured or the reference image is scaled based on the ratio. For example, if object A occupies 15 pixels in the image, and it needs to be reduced by 1.5 times according to the object-image ratio function, then object A is reduced as a whole so that object A occupies 10 pixels in the image.

[0037] After obtaining the image pair to be detected, since the object-image ratio of the images in the image pair to be detected is consistent, the corresponding deformation can be obtained based on the pixel distance between the pixel points corresponding to the same point of the target object between the images in the image pair to be detected, thereby realizing deformation measurement. Specifically, determining the deformation of the target object at the time corresponding to the image to be measured relative to the time corresponding to the reference image based on the image pair to be detected includes: Perform feature point detection on the two images in the image pair to be detected respectively to obtain a plurality of first feature points and a plurality of second feature points; Matching the first feature point and the second feature point to obtain a feature point pair; Determine the deformation of the target object at the time corresponding to the image to be measured relative to the time corresponding to the reference image based on the pixel positions of the feature point pairs; The image pair to be detected is a first image pair, a second image pair or a third image pair. The first image pair includes two conversion images, the second image pair includes a conversion image and a reference image, and the third image pair includes a conversion image and an image to be measured.

[0038] The method provided by the present invention realizes the matching of pixel points in the image pair to be detected by performing feature point detection on the image pair to be detected, that is, identifying the pixel points corresponding to the same actual point from the image pair to be detected.

[0039] Feature point detection is performed on the two images in the image pair to be detected, respectively, to obtain a plurality of first feature points and a plurality of second feature points, including: Inputting the images in the image pair to be detected into the trained feature point detection model respectively, and obtaining the feature point detection results output by the feature point detection model, wherein the feature point detection results include a plurality of first feature points or a plurality of second feature points; Among them, the feature point detection model includes a multi-scale feature module and a fusion module. The multi-scale feature module is used to construct a feature pyramid based on the image in the image pair to be detected, and output the corresponding intermediate feature points based on each layer of feature images in the feature pyramid. The fusion module is used to output the feature point detection results of the image in the image pair to be detected based on the intermediate feature points corresponding to each layer of feature images.

[0040] In the method provided by the present invention, a multi-scale processing mechanism is adopted to work simultaneously on images of different resolutions, effectively extract feature points of various scales, and fuse the feature points detected at various scales, which can effectively improve the accuracy of the detected feature points, ensure that the detected feature points are representative key points, and thus improve the accuracy of deformation measurement.

[0041] Each image in the image pair to be detected can be used as a target image. The target image is input into the trained feature point detection model. First, a feature pyramid is constructed through the multi-scale feature module in the feature point detection model. The pyramid includes multiple layers of feature images, and the resolution of each layer of feature images is different. Specifically, the multi-scale feature module includes multiple detection network layers, each layer includes an image feature extraction module and a feature point head. The image feature extraction module is used to extract the feature image of the corresponding resolution of the layer, and the feature point head is used to perform feature point detection based on the feature image of the layer, and output the intermediate feature points corresponding to the feature image of the layer.

[0042] Furthermore, after outputting the intermediate feature points corresponding to each layer of feature images, each intermediate feature point is fused to obtain the feature point detection result of the target image. Specifically, the fusion of each intermediate feature point can be achieved based on the confidence of each intermediate feature point. The confidence of the intermediate feature point is also output at the same time as the intermediate detection point is output at the feature point head. The intermediate feature points corresponding to each feature image and the confidence of the intermediate feature point are input into the fusion module to obtain the feature point detection result of the target image output by the fusion module, which specifically includes: Through the fusion module, perform the following operations: Map the intermediate feature points to the same scale; Select the middle feature point with the largest confidence as the feature point to be processed, and obtain the overlap between the middle feature point and the feature point to be processed in the neighborhood of the feature point to be processed, where the overlap reflects the similarity between the middle feature point and the feature point to be processed; Delete the intermediate feature points whose overlap is higher than the preset threshold; Select the intermediate feature point with the largest confidence from the intermediate feature points after removing the feature point to be processed as the new feature point to be processed, and repeat the steps of obtaining the overlap between the intermediate feature points in the neighborhood of the feature point to be processed and the feature point to be processed, until all the intermediate feature points are traversed; The retained intermediate feature points are used as the feature point detection results of the target image.

[0043] As can be seen from the previous description, the multi-scale feature module outputs the feature point detection results at multiple resolutions, and maps the intermediate feature points at each resolution to the same scale, that is, converts the position coordinates of the intermediate feature points at each resolution to the image coordinates at the same resolution. For example, based on the feature image with a resolution of a*b, the coordinates of the intermediate feature point A are detected as (x1, y1). When it is converted to the image coordinate system with a resolution of 2a*2b, the coordinates of the intermediate feature point A will change accordingly, so that the actual content corresponding to the position coordinates of the intermediate feature point at two scales is consistent.

[0044] For each intermediate feature point converted to the same scale, first select the intermediate feature point with the largest confidence as the feature point to be processed, and search for the intermediate feature point in the neighborhood of the feature point to be processed. The neighborhood of the feature point to be processed refers to a domain composed of pixels within a preset range (e.g., 4 pixel distances) of the pixel distance from the feature point to be processed. The intermediate feature points found in the field of the feature point to be processed are respectively calculated for overlap with the feature point to be processed. The overlap reflects the similarity between the intermediate feature point and the feature point to be processed. The higher the overlap, the greater the possibility that the intermediate feature point and the feature point to be processed are actually detecting the same position point. The method provided by the present invention can effectively reduce the redundancy of feature points, optimize the representation of feature points, and improve the stability and robustness of feature points in deformation analysis by screening the intermediate feature points in the field of intermediate feature points with higher confidence using the overlap.

[0045] Specifically, obtaining the overlap between the intermediate feature point in the neighborhood of the feature point to be processed and the feature point to be processed includes: Obtain feature descriptors of intermediate feature points and feature points to be processed respectively; The overlap between the intermediate feature points and the feature points to be processed is determined based on the feature descriptors of the intermediate feature points and the feature points to be processed.

[0046] The feature descriptor of the intermediate feature point can be output together when detecting the intermediate feature point. The feature descriptor of the intermediate feature point describes the intermediate feature point. In the method provided by the present invention, if the similarity between the intermediate feature point and the feature descriptor of the feature point to be processed reaches a preset similarity threshold, then it is determined that the overlap between the intermediate feature point and the feature point to be processed is higher than the preset threshold, and the intermediate feature point with the overlap higher than the preset threshold is deleted. After that, the intermediate feature point with the highest confidence is continued to be selected as the new feature point to be processed among the intermediate feature points after removing the current feature point to be processed, and the steps of searching for and processing the intermediate feature points in the field of the feature point to be processed described above are repeated until all the intermediate feature points (excluding the deleted intermediate feature points) are used as feature points to be processed once. Finally, the intermediate feature points that have not been deleted are used as the feature point detection results of the target image.

[0047] The feature point detection model can be trained based on multiple sets of training data, each set of training data includes a sample image and a feature point detection result corresponding to the sample image. The training data can be obtained based on an existing feature point annotation dataset.

[0048] After obtaining each first feature point and the second feature point, the first feature point and the second feature point are matched. Feature point matching can adopt an existing feature point matching method, such as a matching algorithm based on Euclidean distance, a descriptor-based method (such as FLANN, Fast Library for Approximate Nearest Neighbors) or other effective matching algorithms. In the matching process, the RANSAC algorithm can be combined to eliminate false matches and improve the accuracy of matching.

[0049] The first feature point and the second feature point that are successfully matched are considered to be the same point on the corresponding target object. The change in the coordinate position between the first feature point and the second feature point can reflect the change in position of the same point on the target object at different times, that is, deformation. Therefore, according to the change in the spatial position of the feature points after matching, the deformation data of the target object can be calculated using a geometric change model (such as affine transformation or perspective transformation).

[0050] The following is a description of the deformation measurement device based on the object-image ratio provided by the present invention. The deformation measurement device based on the object-image ratio described below and the deformation measurement method based on the object-image ratio described above can be referred to each other. Figure 2 As shown, the deformation measurement device based on object-image ratio provided by the present invention includes: An image acquisition module 210 is used to acquire a reference image of the target object and an image to be measured, wherein the reference image and the image to be measured respectively reflect the states of the target object at different times; The object-image ratio determination module 220 is used to determine the object-image ratios corresponding to the reference image and the image to be measured respectively based on the imaging focal lengths of the reference image and the image to be measured, wherein the object-image ratio of the image reflects the difference between the pixel distance in the image and the actual distance; An image conversion module 230 is used to convert the image to be measured and / or the reference image based on the object-image ratios respectively corresponding to the reference image and the image to be measured, so as to obtain an image pair to be detected, wherein the object-image ratios corresponding to the two images in the image pair to be detected are consistent; The deformation analysis module 240 is used to determine the deformation of the target object at the time corresponding to the image to be measured relative to the time corresponding to the reference image based on the image pair to be detected.

[0051] Figure 3 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 3 As shown, the electronic device may include: a processor 310, a communication interface 320, a memory 330 and a communication bus 340, wherein the processor 310, the communication interface 320 and the memory 330 communicate with each other through the communication bus 340. The processor 310 may call the logic instructions in the memory 330 to execute the deformation measurement method based on the object-image ratio, and the deformation measurement method based on the object-image ratio includes: obtaining a reference image of the target object and an image to be measured, wherein the reference image and the image to be measured respectively reflect the state of the target object at different times; determining the object-image ratios corresponding to the reference image and the image to be measured respectively based on the imaging focal lengths of the reference image and the image to be measured, wherein the object-image ratio of the image reflects the difference between the pixel distance in the image and the actual distance; converting the image to be measured and / or the reference image based on the object-image ratios corresponding to the reference image and the image to be measured respectively, and obtaining an image pair to be detected, wherein the object-image ratios corresponding to the two images in the image pair to be detected are consistent; determining the deformation of the target object at the time corresponding to the image to be measured relative to the time corresponding to the reference image based on the image pair to be detected.

[0052] In addition, the logic instructions in the above-mentioned memory 330 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0053] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the deformation measurement method based on the object-image ratio provided above. The deformation measurement method based on the object-image ratio includes: obtaining a reference image of the target object and an image to be measured, the reference image and the image to be measured respectively reflecting the state of the target object at different times; based on the imaging focal lengths of the reference image and the image to be measured, determining the object-image ratios corresponding to the reference image and the image to be measured respectively, the object-image ratio of the image reflects the difference between the pixel distance in the image and the actual distance; based on the object-image ratios corresponding to the reference image and the image to be measured respectively, converting the image to be measured and / or the reference image to obtain an image pair to be detected, the object-image ratios corresponding to the two images in the image pair to be detected are consistent; based on the image pair to be detected, determining the deformation of the target object at the time corresponding to the image to be measured relative to the time corresponding to the reference image.

[0054] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the deformation measurement method based on the object-image ratio provided above, the deformation measurement method based on the object-image ratio comprising: obtaining a reference image of the target object and an image to be measured, the reference image and the image to be measured respectively reflecting the state of the target object at different moments; determining the object-image ratios corresponding to the reference image and the image to be measured respectively based on the imaging focal lengths of the reference image and the image to be measured, the object-image ratio of the image reflecting the difference between the pixel distance in the image and the actual distance; converting the image to be measured and / or the reference image based on the object-image ratios corresponding to the reference image and the image to be measured respectively to obtain an image pair to be detected, the object-image ratios corresponding to the two images in the image pair to be detected being consistent; determining the deformation of the target object at the moment corresponding to the image to be measured relative to the moment corresponding to the reference image based on the image pair to be detected.

[0055] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0056] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0057] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A deformation measurement method based on object-image ratio, characterized in that: include: Acquire a reference image and an image to be measured of the target object, wherein the reference image and the image to be measured respectively reflect the states of the target object at different times; Determining the object-image ratios corresponding to the reference image and the image to be measured respectively based on the imaging focal lengths of the reference image and the image to be measured, wherein the object-image ratios of the images reflect the difference between the pixel distance in the image and the actual distance; Based on the object-image ratios respectively corresponding to the reference image and the image to be measured, the image to be measured and / or the reference image are converted to obtain an image pair to be detected, wherein the object-image ratios corresponding to the two images in the image pair to be detected are consistent; Based on the pair of images to be detected, a deformation of the target object at a time corresponding to the image to be measured relative to a time corresponding to the reference image is determined.

2. The deformation measurement method based on object-image ratio according to claim 1, characterized in that: The determining, based on the imaging focal lengths of the reference image and the image to be measured, the object-image ratios respectively corresponding to the reference image and the image to be measured comprises: Obtaining the object-image ratios corresponding to the reference image and the image to be measured respectively based on a preset formula; The preset formula is: ; in, is the object-image ratio corresponding to the image, is the distance between the camera and the target object, and is the fitting coefficient corresponding to the imaging focal length of the image.

3. The deformation measurement method based on object-image ratio according to claim 1, characterized in that: The converting the image to be measured and / or the reference image based on the object-image ratios respectively corresponding to the reference image and the image to be measured to obtain the image pair to be detected includes: Obtaining a reference object-image ratio, where the reference object-image ratio is the object-image ratio corresponding to the image to be measured, the object-image ratio corresponding to the reference image, or another preset object-image ratio; Based on the reference object-image ratio and the object-image ratio of the image to be measured and / or the reference image, the image to be measured and / or the reference image are converted to obtain the image pair to be detected.

4. The deformation measurement method based on object-image ratio according to claim 3, characterized in that: The converting the image to be measured and / or the reference image based on the reference object-image ratio and the object-image ratio of the image to be measured and / or the reference image to obtain the image pair to be detected includes: Acquire a ratio of the object-image ratio of the image to be measured and / or the reference image to the reference object-image ratio; The image content of the image to be measured and / or the reference image is scaled based on the ratio to obtain an image in the pair of images to be detected.

5. The deformation measurement method based on object-image ratio according to claim 1, characterized in that: The determining, based on the pair of images to be detected, the deformation of the target object at the time corresponding to the image to be measured relative to the time corresponding to the reference image, comprises: Perform feature point detection on the two images in the image pair to be detected respectively to obtain a plurality of first feature points and a plurality of second feature points; Matching the first feature point and the second feature point to obtain a feature point pair; Determining, based on the pixel positions of the feature point pairs, the deformation of the target object at the time corresponding to the image to be measured relative to the time corresponding to the reference image; The image pair to be detected is a first image pair, a second image pair or a third image pair, the first image pair includes two of the conversion images, the second image pair includes the conversion image and the reference image, and the third image pair includes the conversion image and the image to be measured.

6. The deformation measurement method based on object-image ratio according to claim 5, characterized in that: The method of performing feature point detection on two images in the image pair to be detected to obtain a plurality of first feature points and a plurality of second feature points comprises: Inputting the images in the to-be-detected image pair into a trained feature point detection model respectively, and obtaining a feature point detection result output by the feature point detection model, wherein the feature point detection result includes the plurality of first feature points or the plurality of second feature points; Among them, the feature point detection model includes a multi-scale feature module and a fusion module. The multi-scale feature module is used to construct a feature pyramid based on the image in the image pair to be detected, and output the corresponding intermediate feature points based on each layer of feature images of the feature pyramid. The fusion module is used to output the feature point detection results of the images in the image pair to be detected based on the intermediate feature points corresponding to each layer of the feature images.

7. A deformation measurement device based on object-image ratio, characterized in that: include: An image acquisition module, used to acquire a reference image of the target object and an image to be measured, wherein the reference image and the image to be measured respectively reflect the state of the target object at different times; An object-image ratio determination module, used to determine the object-image ratios corresponding to the reference image and the image to be measured respectively based on the imaging focal lengths of the reference image and the image to be measured, wherein the object-image ratio of the image reflects the difference between the pixel distance in the image and the actual distance; An image conversion module, configured to convert the image to be measured and / or the reference image based on the object-image ratios respectively corresponding to the reference image and the image to be measured, so as to obtain an image pair to be detected, wherein the object-image ratios corresponding to the two images in the image pair to be detected are consistent; The deformation analysis module is used to determine the deformation of the target object at a time corresponding to the image to be measured relative to a time corresponding to the reference image based on the image pair to be detected.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the deformation measurement method based on the object-image ratio as described in any one of claims 1 to 6 is implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the deformation measurement method based on the object-image ratio as described in any one of claims 1 to 6 is implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the deformation measurement method based on the object-image ratio as described in any one of claims 1 to 6 is implemented.

Images