Machine vision identification method for flatness detection of road prefabricated parts

Through machine vision recognition method, using three-dimensional model and grayscale image processing technology, combined with anti-slip chute or shrinkage contour analysis, efficient and autonomous detection of flatness of road prefabricated components is achieved, solving the low efficiency and high manual control requirements in the existing technology The problem.

CN119228766AActive Publication Date: 2024-12-31INNER MONGOLIA TECHN COLLEGE OF CONSTR
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411355012.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-27
Publication Date
2024-12-31
Estimated Expiration
2044-09-27

AI Technical Summary

Technical Problem

The prior art is less efficient when detecting the flatness of road prefabricated components and requires professional and technical personnel to control it. The ink paste and white paper methods are easily affected by moisture, resulting in unclear patterns and inability to effectively adjust the equipment level.

Method used

Using machine vision recognition method, a three-dimensional model is constructed by uploading prefabricated specification parameters, designing image acquisition areas and paths, collecting and optimizing images, converting them into grayscale images, using OpenCV library processing, and analyzing flatness with anti-slip chute or shrinkage contours. Realize independent detection.

Benefits of technology

The efficiency and accuracy of flatness detection of road prefabricated components is improved, the demand for manual control is reduced, and the census can be realized, and the spot check problem in the prior art is avoided.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119228766A_ABST
    Figure CN119228766A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of prefabricated part detection, in particular to a machine vision identification method for road prefabricated part flatness detection, which comprises the following steps: uploading prefabricated part specification parameters, constructing a prefabricated part three-dimensional model based on prefabricated part structure parameters, and designing a prefabricated part image acquisition area and an image acquisition path on the prefabricated part three-dimensional model; according to the method, the surface image of the road prefabricated part is collected to serve as the flatness detection basis, and in the flatness detection process, the surface image of the road prefabricated part is collected to serve as the surface image of the road prefabricated part, so that the flatness of the road prefabricated part is detected. The surface image optimization, gray level conversion and contour extraction of the road prefabricated part are further carried out, the flatness of the road prefabricated part is finally judged by combining the anti-skid groove and the shrinkage seam contour of the surface of the road prefabricated part as reference, the requirement degree of the process for manual control is low, and autonomous detection of the flatness of the road prefabricated part can be completed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of prefabricated component detection, and in particular to a machine vision recognition method for detecting the flatness of prefabricated road components. Background Art

[0002] Road smoothness is one of the important indicators to measure road quality. It reflects the smoothness of the road surface and directly affects the comfort and safety of driving. Roads with high smoothness can reduce vehicle bumps, reduce tire wear, and increase driving speed. Good road smoothness also helps reduce traffic noise and vehicle fuel consumption.

[0003] The invention patent with application number 202011531013.3 discloses a flatness detection device, including: a nozzle standard part having a flat lower surface; a detection platform having an upper surface and a lower surface parallel to each other; a light outlet hole exposed on the upper surface of the detection platform; a light source arranged in the light outlet hole; the detection platform includes a groove exposed on the upper surface of the detection platform, the light outlet hole is exposed to the groove and is concentrically arranged with the groove; the peripheral wall of the groove and / or the inner wall of the light outlet hole have a smooth surface; the peripheral wall of the groove has a keyway array for quantifying the direction and / or angle of the flatness defect; the keyway array is regularly arranged along the peripheral wall of the groove; the keyway array has an angle scale value along the peripheral wall direction of the groove.

[0004] This application aims to solve the problem that "after taking into account the influence of the thickness of the pressure-sensitive paper, the technicians adopted another method to cancel the pressure-sensitive paper, that is, to use ink pad to print the bottom of the suction nozzle, and to use ordinary white paper to judge the horizontal state of the equipment and components, that is, the ink pad prints a corresponding pattern on the white paper, and the clear distribution of the pattern is used to judge the horizontal state and make adjustments. However, ink pad and ordinary white paper bring another problem, that is, both ink pad and white paper are easily affected by moisture. White paper easily absorbs moisture, and ink pad has a certain amount of moisture. After the bottom of the suction nozzle contacts the white paper, the pattern is easily blurred, and the printed graphics are qualified. This obviously cannot be used as the main method to adjust the equipment level."

[0005] However, for prefabricated road components (prefabricated road slabs), their flatness is also very important in the manufacturing process. At present, most of them use the three-meter ruler method or laser flatness meter to test the flatness. The testing process is inefficient and requires professional technicians to operate the testing equipment. To this end, we proposed a machine vision recognition method for flatness detection of prefabricated road components. Summary of the invention

[0006] In view of the above-mentioned shortcomings of the prior art, the present invention provides a machine vision recognition method for flatness detection of prefabricated road components, which solves the problems raised in the above-mentioned background technology.

[0007] To achieve the above objectives, the present invention is implemented through the following technical solutions: A machine vision recognition method for detecting the flatness of a prefabricated road component, comprising: Upload the prefabricated part specification parameters, build the prefabricated part 3D model based on the prefabricated part structure parameters, and design the prefabricated part image acquisition area and image acquisition path on the prefabricated part 3D model; The prefabricated image is collected based on the prefabricated image collection area and the collection path, the collected prefabricated image is optimized, and the optimized prefabricated image is further converted into a grayscale image; When the optimized prefabricated image is converted into a grayscale image, the optimized prefabricated image is input into the Python OpenCV library, and the corresponding grayscale image is output based on the OpenCV library processing; The optimization processing logic of the prefab image is expressed as: ; Where: To optimize the pixel value of the output pixel; is the pixel value of pixel (x, y) in the original prefab image; is the brightness of pixel (x, y); is the average brightness of the original preform image; is centered at pixel (x, y) The local contrast of the window; is the global contrast of the original preform image; is the saturation value of pixel (x, y); is the average saturation value of the original prefab image; is the noise level of the original preform image; Wherein, based on the above output preform image of each pixel , apply each group Adjusting and optimizing the prefabricated component image to obtain an optimized prefabricated component image; The obtained grayscale images are arranged and combined according to the positions of the corresponding preform images in the acquisition path to obtain a complete preform grayscale image, the preform grayscale image is symmetrically segmented based on the midline of the preform grayscale image, and the two segmented sub-preform grayscale images are decomposed again into an arrangement and combination state to obtain two groups of grayscale image groups; The prefabricated part flatness analysis logic is set, the two groups of grayscale images are applied to the prefabricated part flatness analysis logic, and the flatness of the prefabricated part is analyzed based on the prefabricated part flatness analysis logic.

[0008] Furthermore, the model construction ratio applied when constructing the prefabricated three-dimensional model is 1:1, the prefabricated image acquisition area is the area defined by the largest surface on the prefabricated three-dimensional model, the prefabricated image acquisition path is S-shaped, and the acquisition area size of a single prefabricated image is subject to the requirement that the higher the flatness of the prefabricated part, the smaller the prefabricated image acquisition area, and vice versa; The size of the single prefabricated part image acquisition area is customized by the user end, the starting point and the end point of the prefabricated part image acquisition path are the center points of two diagonal groups of prefabricated part images in the prefabricated part image acquisition area, and each group of prefabricated part images has the same size and shape; Wherein, the surface of the preform corresponding to the preform image acquisition area is provided with an anti-slip groove or a shrinkage joint.

[0009] Furthermore, the preform image is collected by a collection module, and the collection module includes a frame, a truss, and a high-precision industrial camera. The truss is installed on the top of the frame through an electric slide rail, and the high-precision industrial camera is installed on the bottom of the truss through an electric slide rail. Two sets of electric slide rails connected to the integrated components of the collection module drive the truss and the high-precision industrial camera to operate based on the preform image collection path, so that each time the high-precision industrial camera moves to a length distance equal to the length or width of a single preform image, the preform image is collected once, and the collected preform images are marked with collection position coordinates and stored synchronously in the high-precision industrial camera; The acquisition position coordinates used for the prefabricated image mark are obtained in the prefabricated three-dimensional model construction space, and the high-precision industrial camera in the acquisition module traverses the acquisition position coordinates of the prefabricated image mark stored internally in real time. When the acquisition position coordinates of the prefabricated image mark traverse to the point where the starting point and the end point of the prefabricated image acquisition path are included, the acquisition module ends operation; The preforms are transported to the bottom of the collection module by the transport device, and the top edges of the preforms are all within the space defined by the frame in the collection module.

[0010] Furthermore, the high-precision industrial camera performs continuous acquisition of prefabricated images at the same position during the prefabricated image acquisition stage, and the continuous acquisition is subject to: the acquisition time is 0.5 to 1 second, the number of prefabricated images acquired is not less than 30, and the amount of information contained in each prefabricated image is further identified, and a group of prefabricated images with the highest amount of information is selected as the prefabricated images finally acquired at the acquisition position; The determination logic of the amount of information contained in the prefab image is expressed as: ; Where: is the information content of the prefab image; is the number of color types in the prefab image; is the probability of the i-th color appearing in the preform image; is the prefab image resolution; is the average value of the grayscale difference between adjacent pixels in the preform image; is the number of edge pixels of the prefab image; is the total number of pixels of the prefab image; is the contrast of the preform image; The energy of the prefab image; is the entropy of the prefab image; , , is the weight; The sum of the three weights is 1, and the information content of the prefabricated image is The larger the value, the more information the prefabricated image contains, and vice versa, the less information the prefabricated image contains.

[0011] Furthermore, the local contrast The window size centered at pixel (x, y) applied when determining the value follows: ; Where: The total amount of prefabricated part images collected by the collection module; is a constant; in, The value is rounded up, constant ≥1, and is customized by the user, and the value of q is further determined based on formula (2).

[0012] Furthermore, when the grayscale image of the preform is segmented based on its midline, the midline used is the midline of the grayscale image of the preform in a direction parallel to the anti-slip groove or the shrinkage joint, and after the grayscale image of the preform is segmented, any one of the two groups of grayscale images of the sub-preforms obtained by segmentation is selected to perform mirror processing, and the grayscale images of the sub-preforms that have been subjected to the mirror processing are fully covered with the position coordinates of the other group of grayscale images of the sub-preforms that have not been subjected to the mirror processing. The position coordinates of each grayscale image in the two grayscale image groups correspond one to one.

[0013] Furthermore, before the flatness of the preform is analyzed based on the analysis logic, a Sobel template is synchronously applied to each grayscale image in the two grayscale image groups to output a contour image, and the flatness of the preform is further analyzed based on the contour image corresponding to each grayscale image in the two grayscale image groups. The preform flatness analysis logic is expressed as: ; Where: is the flatness performance value of the prefabricated part; is the set of corresponding coordinates of the contour image; is the contour overlap ratio in the contour images corresponding to the two sets of grayscale images corresponding to the vth set of coordinates in the two sets of grayscale images; is a set of contours representing anti-skid grooves or contraction joints in the contour image; is the profile rate of the jth group of contours representing the anti-slip groove or shrinkage joint in the contour image a corresponding to the grayscale image corresponding to the vth group of coordinates; is the profile rate of the jth group of contours representing the anti-slip groove or shrinkage joint in the contour image b corresponding to the grayscale image corresponding to the vth group of coordinates; in, Table pair The average, Table pair Average, flatness performance value of prefabricated parts The larger the value is, the flatter the preform is, and vice versa, the worse the flatness of the preform is. The corresponding coordinates of the grayscale image are the center coordinates of the grayscale image.

[0014] Furthermore, the overlap rate of the two sets of contour images is expressed as: ; Where: is the total number of pixels in the intersection of the pixels representing the contours in contour a and contour b; It is the total number of pixels in the union of the pixels representing the contours in contour a and contour b.

[0015] Furthermore, the profile rate of the profile of the anti-slip groove or the shrinkage joint in the profile image is calculated by the following formula: ; Where: The number of pixels on the contour representing the anti-skid groove or the shrinkage joint that do not fall on the straight line connecting the two end points of the contour representing the anti-skid groove or the shrinkage joint; The total number of pixels on the outline representing the anti-slip groove or shrinkage joint.

[0016] Furthermore, the flatness performance value of the preform After obtaining the result based on the analysis logic, the prefabricated part flatness judgment threshold is further set based on the prefabricated part flatness performance value. The prefabricated part is compared with the prefabricated part flatness determination threshold to determine whether the prefabricated part is flat.

[0017] Compared with the known public technology, the technical solution provided by the present invention has the following beneficial effects: The present invention provides a machine vision recognition method for flatness detection of prefabricated road components. During the execution of the method, the surface image of the prefabricated road component is collected as a basis for flatness detection. During the flatness detection process, the surface image of the prefabricated road component is further optimized, grayscale converted and contour extracted, and the anti-skid groove and shrinkage joint contours on the surface of the prefabricated road component are combined as references to make a final judgment on the flatness of the prefabricated road component. The process has a low demand for manual control, can complete the autonomous detection of the flatness of the prefabricated road component, and has higher efficiency than the prior art, can realize a census, and avoid the situation where spot checks based on the prior art are carried out to improve the detection results. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0019] Figure 1 A schematic diagram of a process flow of a machine vision recognition method for detecting the flatness of prefabricated road components; Figure 2 It is a structural schematic diagram of the acquisition module in the present invention; Figure 3 This is a schematic diagram of an example of a preform image acquisition path in the present invention; The numbers in the figure represent: 1. frame; 2. truss; 3. high-precision industrial camera. DETAILED DESCRIPTION

[0020] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0021] The present invention will be further described below in conjunction with the embodiments. Example

[0022] A machine vision recognition method for detecting the flatness of a prefabricated road component in this embodiment is as follows: Figure 1 As shown, including: Upload the prefabricated part specification parameters, build the prefabricated part 3D model based on the prefabricated part structure parameters, and design the prefabricated part image acquisition area and image acquisition path on the prefabricated part 3D model; The prefabricated image is collected based on the prefabricated image collection area and the collection path, the collected prefabricated image is optimized, and the optimized prefabricated image is further converted into a grayscale image; When the optimized prefabricated image is converted into a grayscale image, the optimized prefabricated image is input into the OpenCV library of Python, and the corresponding grayscale image is output based on the processing of the OpenCV library; The optimization processing logic of prefab images is expressed as: ; Where: To optimize the pixel value of the output pixel; is the pixel value of pixel (x, y) in the original prefab image; is the brightness of pixel (x, y); is the average brightness of the original preform image; is centered at pixel (x, y) The local contrast of the window; is the global contrast of the original preform image; is the saturation value of pixel (x, y); is the average saturation value of the original prefab image; is the noise level of the original preform image; Among them, based on the above output prefabricated component image of each pixel , apply each group Adjusting and optimizing the prefabricated component image to obtain an optimized prefabricated component image; Local contrast The window size centered at pixel (x, y) applied when determining the value follows: ; Where: The total amount of prefabricated part images collected by the collection module; is a constant; in, The value is rounded up, constant ≥1, and is customized by the user, and the value of q is further determined based on formula (2); The obtained grayscale images are arranged and combined according to the positions of the corresponding preform images in the acquisition path to obtain a complete preform grayscale image, the preform grayscale image is symmetrically segmented based on the midline of the preform grayscale image, and the two segmented sub-preform grayscale images are decomposed again into an arrangement and combination state to obtain two groups of grayscale image groups; Setting the prefabricated part flatness analysis logic, applying the two groups of grayscale images to the prefabricated part flatness analysis logic, and analyzing the flatness of the prefabricated part based on the prefabricated part flatness analysis logic; Before the flatness of the prefabricated part is analyzed based on the analysis logic, the Sobel template is applied to each grayscale image in the two grayscale image groups to output the contour image, and the flatness of the prefabricated part is further analyzed based on the contour image corresponding to each grayscale image in the two grayscale image groups. The logic of the prefabricated part flatness analysis is expressed as: ; Where: is the flatness performance value of the prefabricated part; is the set of corresponding coordinates of the contour image; is the contour overlap ratio in the contour images corresponding to the two sets of grayscale images corresponding to the vth set of coordinates in the two sets of grayscale images; is a set of contours representing anti-skid grooves or contraction joints in the contour image; is the profile rate of the jth group of contours representing the anti-slip groove or shrinkage joint in the contour image a corresponding to the grayscale image corresponding to the vth group of coordinates; is the profile rate of the jth group of contours representing the anti-slip groove or shrinkage joint in the contour image b corresponding to the grayscale image corresponding to the vth group of coordinates; in, Table pair The average, Table pair Average, flatness performance value of prefabricated parts The larger the value is, the flatter the preform is. Conversely, the smaller the value is, the worse the flatness of the preform is. The corresponding coordinates of the grayscale image are the center coordinates of the grayscale image. The overlap rate of two sets of contour images is expressed as: ; Where: is the total number of pixels in the intersection of the pixels representing the contours in contour a and contour b; is the total number of pixels in the union of the pixels representing the contours in contour a and contour b; The profile ratio of the profile representing the anti-slip groove or shrinkage joint in the profile image is calculated by the following formula: ; Where: The number of pixels on the contour representing the anti-skid groove or the shrinkage joint that do not fall on the straight line connecting the two end points of the contour representing the anti-skid groove or the shrinkage joint; The total number of pixels on the outline representing the anti-skid groove or shrinkage joint; Prefabricated parts flatness performance value After obtaining the result based on the analysis logic, the prefabricated part flatness judgment threshold is further set based on the prefabricated part flatness performance value. The prefabricated part is compared with the prefabricated part flatness determination threshold to determine whether the prefabricated part is flat.

[0023] In this embodiment, through the execution of the method in the above embodiment, a method for detecting the flatness of prefabricated road components based on machine vision is provided. Compared with the existing technology, the detection efficiency and accuracy are better, the manual management cost is lower, and quality control is provided for the production and manufacturing of prefabricated road components.

[0024] Embodiment 2: In terms of specific implementation, based on Example 1, this example refers to Figure 2~3 The machine vision recognition method for detecting the flatness of prefabricated road components in Example 1 is further described in detail: The model construction ratio applied when constructing the prefabricated 3D model is 1:1. The prefabricated image acquisition area is the area defined by the largest surface on the prefabricated 3D model. The prefabricated image acquisition path is S-shaped. The acquisition area of ​​a single prefabricated image is subject to the requirement of the flatness of the prefabricated. The higher the flatness requirement of the prefabricated, the smaller the prefabricated image acquisition area is. On the contrary, the larger the prefabricated image acquisition area is. The size of a single prefabricated part image acquisition area is customized by the user end. The starting point and the end point of the prefabricated part image acquisition path are the center points of two diagonal groups of prefabricated part images in the prefabricated part image acquisition area. Each group of prefabricated part images has the same size and shape. Wherein, the surface of the preform corresponding to the preform image acquisition area is provided with an anti-slip groove or a shrinkage joint; The prefabricated part image is collected by the acquisition module, which is integrated with a frame, a truss, and a high-precision industrial camera. The truss is installed on the top of the frame through an electric slide rail, and the high-precision industrial camera is installed on the bottom of the truss through an electric slide rail. Two sets of electric slide rails connected to the integrated components of the acquisition module drive the truss and the high-precision industrial camera to operate based on the prefabricated part image acquisition path, so that each time the high-precision industrial camera moves to the length or width of a single prefabricated part image, the prefabricated part image is collected once. The collected prefabricated part images are marked with the acquisition position coordinates and are synchronously stored in the high-precision industrial camera; The acquisition position coordinates used for the prefabricated image mark are obtained in the prefabricated three-dimensional model construction space. The high-precision industrial camera in the acquisition module traverses the acquisition position coordinates of the prefabricated image mark stored internally in real time. When the acquisition position coordinates of the prefabricated image mark traverse to the point where the starting point and the end point of the prefabricated image acquisition path are included, the acquisition module ends operation. The prefabricated parts are transported to the bottom of the collection module by the transport device, and the top edges of the prefabricated parts are all within the space defined by the frame in the collection module; During the prefabricated part image acquisition stage, the high-precision industrial camera performs continuous acquisition of prefabricated part images at the same position. The continuous acquisition is subject to the following requirements: the acquisition time is 0.5 to 1 second, and the number of prefabricated part images acquired is not less than 30. The amount of information contained in each prefabricated part image is further identified, and the group of prefabricated part images with the highest amount of information is selected as the final prefabricated part images acquired at the acquisition position. The logic for determining the amount of information contained in a prefab image is expressed as: ; Where: is the information content of the prefab image; is the number of color types in the prefab image; is the probability of the i-th color appearing in the preform image; is the prefab image resolution; is the average value of the grayscale difference between adjacent pixels in the preform image; is the number of edge pixels of the prefab image; is the total number of pixels of the prefab image; is the contrast of the preform image; The energy of the prefab image; is the entropy of the prefab image; , , is the weight; The sum of the three weights is 1, and the information content of the prefabricated image is The larger the value, the more information the prefabricated image contains, and vice versa, the less information the prefabricated image contains.

[0025] Through the above arrangement, further step execution data support is provided for the method in Example 1, and the amount of information contained in the preform image is limited to calculate the logic formula; See also Figure 2 As shown, this figure further shows the structure in the acquisition module; See also Figure 3 As shown, the square box in the figure represents the preform image, and the dotted S-shaped arrow in the figure represents the preform image acquisition path.

[0026] Embodiment 3: In terms of specific implementation, based on Example 1, this example refers to Figure 1 The machine vision recognition method for detecting the flatness of prefabricated road components in Example 1 is further described in detail: When the grayscale image of the preform is segmented based on its center line, the center line used is the center line of the grayscale image of the preform in a direction parallel to the anti-slip groove or the shrinkage joint. After the grayscale image of the preform is segmented, any one of the two groups of grayscale images of the sub-preform obtained by segmentation is selected to perform mirror processing. The grayscale images of the sub-preforms that have been subjected to the mirror processing are fully covered by the position coordinates of the other group of grayscale images of the sub-preforms that have not been subjected to the mirror processing. The position coordinates of each grayscale image in the two grayscale image groups correspond one to one.

[0027] Through the above settings, further preparation is made for the preform flatness analysis of the method in Example 1, ensuring that the conditions for preform flatness analysis are finally met based on the execution of the above steps in Example 1.

[0028] In summary, during the execution of the method in the above embodiment, the surface image of the prefabricated road component is collected as the basis for flatness detection. During the flatness detection process, the surface image of the prefabricated road component is further optimized, grayscale converted and contour extracted, and the anti-skid groove and shrinkage joint contours on the surface of the prefabricated road component are used as a reference to make a final judgment on the flatness of the prefabricated road component. The process has a low demand for manual control, can complete the autonomous detection of the flatness of the prefabricated road component, and has higher efficiency than the existing technology, can realize a census, and avoid spot checks based on the existing technology to improve the detection results.

[0029] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements will not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A machine vision recognition method for flatness detection of prefabricated road components, characterized in that: include: Upload the prefabricated part specification parameters, build the prefabricated part 3D model based on the prefabricated part structure parameters, and design the prefabricated part image acquisition area and image acquisition path on the prefabricated part 3D model; The prefabricated image is collected based on the prefabricated image collection area and the collection path, the collected prefabricated image is optimized, and the optimized prefabricated image is further converted into a grayscale image; When the optimized prefabricated image is converted into a grayscale image, the optimized prefabricated image is input into the Python OpenCV library, and the corresponding grayscale image is output based on the OpenCV library processing; The optimization processing logic of the prefab image is expressed as: ; Where: To optimize the pixel value of the output pixel; is the pixel value of pixel (x, y) in the original prefab image; is the brightness of pixel (x, y); is the average brightness of the original preform image; is centered at pixel (x, y) The local contrast of the window; is the global contrast of the original preform image; is the saturation value of pixel (x, y); is the average saturation value of the original prefab image; is the noise level of the original preform image; Among them, based on the above output prefabricated component image of each pixel , apply each group Adjusting and optimizing the prefabricated component image to obtain an optimized prefabricated component image; The obtained grayscale images are arranged and combined according to the positions of the corresponding preform images in the acquisition path to obtain a complete preform grayscale image, the preform grayscale image is symmetrically segmented based on the midline of the preform grayscale image, and the two segmented sub-preform grayscale images are decomposed again into an arrangement and combination state to obtain two groups of grayscale image groups; The prefabricated part flatness analysis logic is set, the two groups of grayscale images are applied to the prefabricated part flatness analysis logic, and the flatness of the prefabricated part is analyzed based on the prefabricated part flatness analysis logic.

2. A machine vision recognition method for flatness detection of prefabricated road components according to claim 1, characterized in that: The model construction ratio applied when constructing the prefabricated three-dimensional model is 1:1, the prefabricated image acquisition area is the area defined by the largest surface on the prefabricated three-dimensional model, the prefabricated image acquisition path is S-shaped, and the acquisition area size of a single prefabricated image is subject to the requirement of the flatness of the prefabricated part, the higher the prefabricated flatness requirement, the smaller the prefabricated image acquisition, and vice versa, the larger the prefabricated image acquisition; The size of the single prefabricated part image acquisition area is customized by the user end, the starting point and the end point of the prefabricated part image acquisition path are the center points of two diagonal groups of prefabricated part images in the prefabricated part image acquisition area, and each group of prefabricated part images has the same size and shape; Wherein, the surface of the preform corresponding to the preform image acquisition area is provided with an anti-slip groove or a shrinkage joint.

3. The machine vision recognition method for flatness detection of prefabricated road components according to claim 2, characterized in that: The prefabricated part image is collected by a collection module, which includes a frame, a truss, and a high-precision industrial camera. The truss is installed on the top of the frame through an electric slide rail, and the high-precision industrial camera is installed on the bottom of the truss through an electric slide rail. Two sets of electric slide rails connected to the integrated components of the collection module drive the truss and the high-precision industrial camera to operate based on the prefabricated part image collection path, so that each time the high-precision industrial camera moves to a length distance equal to the length or width of a single prefabricated part image, the prefabricated part image is collected once, and the collected prefabricated part images are marked with collection position coordinates and stored synchronously in the high-precision industrial camera; The acquisition position coordinates used for the prefabricated image mark are obtained in the prefabricated three-dimensional model construction space, and the high-precision industrial camera in the acquisition module traverses the acquisition position coordinates of the prefabricated image mark stored internally in real time. When the acquisition position coordinates of the prefabricated image mark traverse to the point where the starting point and the end point of the prefabricated image acquisition path are included, the acquisition module ends operation; The preforms are transported to the bottom of the collection module by the transport device, and the top edges of the preforms are all within the space defined by the frame in the collection module.

4. The machine vision recognition method for flatness detection of prefabricated road components according to claim 3, characterized in that: The high-precision industrial camera performs continuous acquisition of prefabricated images at the same position during the prefabricated image acquisition stage. The continuous acquisition is subject to: the acquisition time is 0.5 to 1 second, the number of prefabricated images acquired is not less than 30, and the amount of information contained in each prefabricated image is further identified, and a group of prefabricated images with the highest amount of information is selected as the prefabricated images finally acquired at the acquisition position; The determination logic of the amount of information contained in the prefab image is expressed as: ; Where: is the information content of the prefab image; is the number of color types in the prefab image; is the probability of the i-th color appearing in the preform image; is the prefab image resolution; is the average value of the grayscale difference between adjacent pixels in the preform image; is the number of edge pixels of the prefab image; is the total number of pixels of the prefab image; is the contrast of the preform image; is the energy of the prefab image; is the entropy of the prefab image; , , is the weight; The sum of the three weights is 1, and the information content of the prefabricated image is The larger the value, the more information the prefabricated image contains, and vice versa, the less information the prefabricated image contains.

5. The machine vision recognition method for flatness detection of prefabricated road components according to claim 1, characterized in that: The local contrast The window size centered at pixel (x, y) applied when determining the value follows: ; Where: The total amount of prefabricated part images collected by the collection module; is a constant; in, The value is rounded up, constant ≥1, and is customized by the user, and the value of q is further determined based on formula (2).

6. The machine vision recognition method for flatness detection of prefabricated road components according to claim 1, characterized in that: When the grayscale image of the preform is segmented based on its midline, the midline used is the midline of the grayscale image of the preform in a direction parallel to the anti-slip groove or the shrinkage joint. After the grayscale image of the preform is segmented, any one of the two groups of grayscale images of the sub-preforms obtained by segmentation is selected to perform mirror processing, and the grayscale images of the sub-preforms that have been subjected to the mirror processing are fully covered by the position coordinates of the other group of grayscale images of the sub-preforms that have not been subjected to the mirror processing. The position coordinates of each grayscale image in the two grayscale image groups correspond one to one.

7. The machine vision recognition method for flatness detection of prefabricated road components according to claim 1, characterized in that: Before the flatness of the preform is analyzed based on the analysis logic, a Sobel template is applied to each grayscale image in the two grayscale image groups to output a contour image, and the flatness of the preform is further analyzed based on the contour image corresponding to each grayscale image in the two grayscale image groups. The preform flatness analysis logic is expressed as: ; Where: is the flatness performance value of the prefabricated part; is the set of corresponding coordinates of the contour image; is the contour overlap ratio in the contour images corresponding to the two sets of grayscale images corresponding to the vth set of coordinates in the two sets of grayscale images; is a set of contours representing anti-skid grooves or contraction joints in the contour image; is the profile rate of the jth group of contours representing the anti-slip groove or shrinkage joint in the contour image a corresponding to the grayscale image corresponding to the vth group of coordinates; is the profile rate of the jth group of contours representing the anti-slip groove or shrinkage joint in the contour image b corresponding to the grayscale image corresponding to the vth group of coordinates; in, Table pair The average, Table pair Average, flatness performance value of prefabricated parts The larger the value is, the flatter the preform is, and vice versa, the worse the flatness of the preform is. The corresponding coordinates of the grayscale image are the center coordinates of the grayscale image.

8. The machine vision recognition method for flatness detection of prefabricated road components according to claim 7, characterized in that: The overlap rate of the two sets of contour images is expressed as: ; Where: is the total number of pixels in the intersection of the pixels representing the contours in contour a and contour b; It is the total number of pixels in the union of the pixels representing the contours in contour a and contour b.

9. The machine vision recognition method for flatness detection of prefabricated road components according to claim 7, characterized in that: The profile rate of the profile of the anti-slip groove or shrinkage joint in the profile image is calculated by the following formula: ; Where: The number of pixels on the contour representing the anti-skid groove or the shrinkage joint that do not fall on the straight line connecting the two end points of the contour representing the anti-skid groove or the shrinkage joint; The total number of pixels on the outline representing the anti-slip groove or shrinkage joint.

10. The machine vision recognition method for flatness detection of prefabricated road components according to claim 7, characterized in that: The flatness performance value of the preform After obtaining the result based on the analysis logic, the prefabricated part flatness judgment threshold is further set based on the prefabricated part flatness performance value. The prefabricated part is compared with the prefabricated part flatness determination threshold to determine whether the prefabricated part is flat.

Citation Information

Patent Citations

  • Free-form surface profile tolerance detection method based on machine vision

    CN113847881A

  • Part surface quality detection method and system based on machine vision

    CN118608504A

  • Device and method for processing color image

    JP1992010079A

  • Image processing-based insulator defect detection method and system

    WO2018086299A1