Wallboard part detection method, system, equipment and medium
Through the combination of imaging equipment and calibration blocks, the wall panel features are mapped to the camera coordinate system, which solves the problem of low measurement accuracy of aircraft wall panel parts, and realizes high-precision feature error detection to meet the accuracy requirements of aircraft assembly technology.
Patent Information
- Application Number
- CN202411148580.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-09-12
- Filing Date
- 2024-08-21
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-08-21
AI Technical Summary
The prior art is difficult to accurately measure the characteristic errors of aircraft wall panel parts, especially because the excessive rounded corners of the edges of the sinking area are less than 1/4 of the arc, making it difficult to use a conventional three-coordinate measuring machine for measurement, resulting in poor accuracy and cannot meet the aircraft. Assembly technology requirements.
Using imaging equipment and calibration blocks, the first image of the wall-type parts to be tested on the water platform surface and the second image of multiple calibration combinations are mapped to the camera coordinate system, feature errors are obtained, and the number and complexity of detection equipment are reduced. , improve accuracy.
The wall panel parts can be measured through a small number of pictures, reducing the difficulty of detection, avoiding the superposition of errors caused by multiple measurements, improving the accuracy of detection, and meeting the accuracy requirements of aircraft assembly technology.
Smart Images

Figure CN119067939A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of part feature detection, and in particular to a wall panel part detection method, system, equipment and medium. Background Art
[0002] The wall panels of aircraft are generally in the shape of a flat plate. In order to reduce weight, there are usually milled sunken areas. Due to the low overall thickness of the wall panel parts, the excessive fillet of the edge of these sunken areas is usually less than 1 / 4 arc, which is difficult to measure using a conventional three-dimensional coordinate measuring machine. In the prior art, a semi-transparent plastic sheet covered with the wall panel frame line is usually used to determine the processing accuracy of the frame line of the sunken area by manual observation and comparison, or an image measuring instrument with a moving axis is used to measure each area one by one to obtain the characteristic error of the wall panel parts. However, the accuracy of these two methods is poor and it is difficult to meet the needs of the development of aircraft assembly technology. Summary of the invention
[0003] The main purpose of the present application is to provide a method, system, equipment and medium for detecting wall panel parts, aiming to solve the technical problem that the existing methods have poor accuracy in obtaining characteristic errors of wall panel parts.
[0004] To achieve the above-mentioned purpose, the present application provides a wall panel parts detection method, which is applied to a controller of a measuring device; wherein the measuring device also includes a horizontal surface, a calibration block and an imaging device, including:
[0005] Receiving a first image of a wall panel part to be measured captured by the imaging device; wherein the wall panel part to be measured is arranged on the horizontal surface, and the wall panel part to be measured includes at least three reference holes;
[0006] Controlling the calibration block to be inserted into each of the reference holes of the wall panel parts to be measured in sequence to form a plurality of calibration combinations, and receiving a plurality of second images of the plurality of calibration combinations acquired by the imaging device; wherein the calibration block is a cylinder, and a flat plate with a calibration pattern is provided on the top of the calibration block;
[0007] According to the first image and the plurality of the second images, the part features in the digital model of the wall panel part to be measured are mapped into the camera coordinate system to obtain the mapping features; wherein the camera coordinate system is established based on the second image;
[0008] The feature error of the wall panel part to be measured is obtained according to the mapping feature and the first image.
[0009] Optionally, the step of mapping part features in the digital model of the wall panel part to be measured to a camera coordinate system according to the first image and the plurality of the second images to obtain the mapping features comprises:
[0010] Obtaining calibration coordinate values of a plurality of calibration blocks through a plurality of the second images;
[0011] Obtaining the hole center coordinate value of each reference hole in the first image through the multiple calibration coordinate values;
[0012] According to the hole center coordinate value, the part feature is mapped to the camera coordinate system to obtain the mapping feature.
[0013] Optionally, the step of obtaining the feature error of the wall panel part to be measured according to the mapping feature and the first image includes:
[0014] Projecting the mapping features onto the first image according to the camera parameter matrix to obtain projection features;
[0015] The feature error is obtained according to the first image and the projection feature.
[0016] Optionally, the step of obtaining the feature error according to the first image and the projection feature includes:
[0017] Extracting edge features on the first image according to the projection features; wherein the projection features include a plurality of projection points;
[0018] According to the edge feature and the projection feature, obtaining a pixel error between each of the projection points and the edge feature;
[0019] The feature error is obtained according to the plurality of pixel errors.
[0020] Optionally, the step of obtaining the feature error according to the plurality of pixel errors comprises:
[0021] The pixel error corresponding to each of the projection points is converted into a physical distance by using a camera parameter matrix to obtain a plurality of first characteristic errors;
[0022] The characteristic error is obtained according to a plurality of the first characteristic errors.
[0023] Optionally, the calibration pattern is a black and white checkerboard pattern.
[0024] Optionally, before the step of controlling the imaging device to measure the wall panel part to be measured and obtaining the first image, the step further includes:
[0025] The internal parameters and external parameters of the imaging device are calibrated.
[0026] In addition, to achieve the above-mentioned purpose, the present application also provides a wall panel parts detection system, the detection system is applied to the controller of the measuring device; wherein the measuring device also includes a horizontal platform, a calibration block and an imaging device, including:
[0027] A first image acquisition module is used to receive a first image of the wall panel part to be measured acquired by the imaging device; wherein the wall panel part to be measured is arranged on the horizontal surface, and the wall panel part to be measured includes at least three reference holes;
[0028] The second image acquisition module is used to control the calibration block to be inserted into each of the reference holes of the wall panel parts to be measured in sequence to form a plurality of calibration combinations, and receive a plurality of second images of the plurality of calibration combinations collected by the imaging device; wherein the calibration block is a cylinder, and a flat plate with a calibration pattern is provided on the top of the calibration block;
[0029] A mapping feature acquisition module, used to map the part features in the digital model of the wall panel part to be measured to a camera coordinate system according to the first image and the plurality of the second images, so as to obtain mapping features; wherein the camera coordinate system is established based on the second image;
[0030] The feature error acquisition module is used to obtain the feature error of the wall panel part to be measured according to the mapping feature and the first image.
[0031] In addition, to achieve the above-mentioned purpose, the present application also provides a computer device, which includes a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the above-mentioned method.
[0032] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, on which a computer program is stored, and a processor executes the computer program to implement the above-mentioned method.
[0033] The beneficial effects that can be achieved by this application.
[0034] The present application provides a method, system, device and medium for detecting wall panel parts, wherein the detection method is applied to a controller of a measuring device; wherein the measuring device further comprises a horizontal surface, a calibration block and an imaging device, and receives a first image of the wall panel part to be measured acquired by the imaging device; wherein the wall panel part to be measured is arranged on the horizontal surface, and the wall panel part to be measured comprises at least three reference holes; the calibration block is controlled to be inserted into each of the reference holes of the wall panel part to be measured in sequence to form a plurality of calibration combinations, and receives a plurality of second images of the plurality of calibration combinations acquired by the imaging device; wherein the calibration block is a cylinder, and a plate with a calibration pattern is arranged on the top of the calibration block; according to the first image and the plurality of the second images, the part features in the digital model of the wall panel part to be measured are mapped to the camera coordinate system to obtain the mapping features; wherein the camera coordinate system is established based on the second image; according to the mapping features and the first image, the feature error of the wall panel part to be measured is obtained. That is, based on simple equipment such as imaging equipment and calibration blocks, the conversion relationship between two-dimensional images is obtained, so that the part features in the digital model are projected onto the two-dimensional image of the actual part, and then the error between the part features of the actual part and the standard digital model is obtained, reducing the number and complexity of the detection equipment; at the same time, the method of the application has no strict requirements on the placement of the parts to be tested. The actual position of the parts can be quickly obtained through the calibration block for detection, thereby improving the efficiency of detection; further, the entire wall panel part can be measured through only a small number of pictures, which reduces the difficulty of detection, avoids the errors caused by obtaining results through multiple measurements in the past, and improves the accuracy of detection. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] Figure 1 A schematic diagram of the computer device structure of the hardware operating environment involved in the embodiments of the present application;
[0036] Figure 2 A schematic diagram of a flow chart of a wall panel parts detection method provided in an embodiment of the present application;
[0037] Figure 3 A schematic diagram of functional modules of a wall panel parts detection system provided in an embodiment of the present application;
[0038] Figure 4 A schematic diagram of a device for acquiring a first image in a wall panel parts detection method provided in an embodiment of the present application;
[0039] Figure 5 A schematic diagram of a calibration pattern on the top of a calibration block in a measuring device of a wall panel parts detection method provided in an embodiment of the present application;
[0040] Figure 6A schematic diagram of points taken on a calibration block of a wall panel parts detection method provided in an embodiment of the present application;
[0041] Figure 7 A schematic diagram of a first image in a wall panel parts detection method provided in an embodiment of the present application;
[0042] Figure 8 A schematic diagram of projection features of a wall panel parts detection method provided in an embodiment of the present application.
[0043] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0044] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0045] The main solution of the embodiment of the present application is: a proposed detection method, system, device and medium for wall panel parts, wherein the detection method is applied to the controller of the measuring device; wherein the measuring device also includes a horizontal platform, a calibration block and an imaging device, by receiving the first image of the wall panel part to be measured collected by the imaging device; wherein the wall panel part to be measured is arranged on the horizontal platform, and the wall panel part to be measured includes at least three reference holes; the calibration block is controlled to be inserted into each of the reference holes of the wall panel part to be measured in turn to form a plurality of calibration combinations, and receive a plurality of second images of the plurality of calibration combinations collected by the imaging device; wherein the calibration block is a cylinder, and a flat plate with a calibration pattern is arranged on the top of the calibration block; according to the first image and the plurality of the second images, the part features in the digital model of the wall panel part to be measured are mapped to the camera coordinate system to obtain the mapping features; wherein the camera coordinate system is established based on the second image; according to the mapping features and the first image, the feature error of the wall panel part to be measured is obtained.
[0046] In the prior art, the wall panel parts of the aircraft are generally in the shape of a flat plate. In order to reduce weight, there are usually milled sunken areas. Due to the low overall thickness of the wall panel parts, the excessive fillet of the edge of these sunken areas is usually less than 1 / 4 arc, which is difficult to measure using a conventional three-dimensional coordinate measuring machine. In the prior art, a semi-transparent plastic plate covered with a wall panel frame line is usually used to determine the processing accuracy of the frame line of the sunken area by manual observation and comparison, or an image measuring instrument with a moving axis is used to measure each area one by one to obtain the characteristic error of the wall panel parts. However, the accuracy of these two methods is poor and it is difficult to meet the needs of the development of aircraft assembly technology.
[0047] To this end, the present application provides a solution, which obtains the conversion relationship between two-dimensional images through simple equipment such as imaging equipment and calibration blocks, so that the part features in the digital model are projected onto the two-dimensional image of the actual part, and then the error between the part features of the actual part and the standard digital model is obtained, reducing the number and complexity of the detection equipment; at the same time, the method of the present application has no strict requirements on the placement of the parts to be tested, and the actual position of the parts can be quickly obtained through the calibration block for detection; further, the entire wall panel part can be measured through only a small number of pictures, which reduces the difficulty of detection, avoids the errors caused by obtaining results through multiple measurements in the past, and improves the accuracy of detection.
[0048] Reference Figure 1 , Figure 1 A schematic diagram of the computer device structure of the hardware operating environment involved in the embodiment of the present application.
[0049] like Figure 1 As shown, the computer device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Disp l ay), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WI re less-Fi de l ity, WI-FI) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volume ile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.
[0050] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the computer device, and may include more or less components than shown in the figure, or combine some components, or arrange the components differently.
[0051] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a data storage module, a network communication module, a user interface module and an electronic program.
[0052] exist Figure 1In the computer device shown, the network interface 1004 is mainly used for data communication with the network server; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the computer device of the present invention can be set in the computer device, and the computer device calls the wall panel parts detection system stored in the memory 1005 through the processor 1001, and executes the wall panel parts detection method provided in the embodiment of the present application.
[0053] Reference Figure 2 Based on the hardware device of the aforementioned embodiment, the embodiment of the present application provides a wall panel parts detection method, the detection method is applied to the controller of the measuring device; wherein the measuring device also includes a horizontal platform, a calibration block and an imaging device, including:
[0054] In a specific embodiment, the detection device is used to detect wall panel parts, including a controller, a horizontal surface, a calibration block and an imaging device, wherein the controller is used to control other components in the measuring device, receive information, and process information, etc.; in this embodiment, the controller can be a component of the aforementioned computer device, or can directly refer to the aforementioned computer device. The computer device can be a component of the measuring device. The horizontal surface is used to carry other components in the measuring device and to carry the wall panel parts to be measured; the calibration block is used to determine the correspondence between object points and image points; the imaging device is used to collect or measure the wall panel parts to be measured, and usually a camera or other measuring device can be used. In this embodiment, an ordinary industrial camera and an ordinary lens are used. In addition, the measuring device also includes components such as a camera bracket.
[0055] As an optional implementation manner, before the step of controlling the imaging device to measure the wall panel part to be measured and obtaining the first image, the method further includes:
[0056] The internal parameters and external parameters of the imaging device are calibrated.
[0057] In the specific implementation process, in order to determine the relationship between the three-dimensional geometric position of a point on the surface of a spatial object and its corresponding point in the image, a geometric model of camera imaging must be established. These geometric model parameters are camera parameters, mainly including internal parameters and external parameters, and the process of solving the parameters is called camera calibration (or camera calibration). The accuracy of the camera calibration result and the stability of the algorithm directly affect the accuracy of the results produced by the camera. Before carrying out the detection task, after setting up the measurement device, it is necessary to calibrate the internal and external parameters of the imaging equipment to provide a basic guarantee for the accuracy of the subsequent detection results.
[0058] S10: receiving a first image of a wall panel part to be measured captured by the imaging device; wherein the wall panel part to be measured is arranged on the horizontal surface, and the wall panel part to be measured includes at least three reference holes;
[0059] In the specific implementation process, Figure 4 As shown, place the wall panel parts to be tested on the horizontal surface directly below the imaging device, so that the bottom surface fits well with the horizontal surface, start the imaging device to shoot the wall panel parts, and obtain the following Figure 7 The first image shown can display the features of the wall panel parts to be tested, such as the sunken area. Since the subsequent detection steps are based on the information in the first image, there is no strict requirement for the placement of the wall panel parts to be tested, which is convenient for actual testing, reduces the time and energy for adjusting the test position, and improves the test efficiency. Most wall panel parts have reference holes, and several holes existing on the parts themselves can be selected as reference holes. Since the calibration method of the calibration block used later requires at least three point coordinates, at least three holes need to be selected as reference holes. In this embodiment, three reference holes perpendicular to the ground are selected from the wall panel parts to be tested, and the aperture is D.
[0060] S20: Controlling the calibration block to be inserted into each of the reference holes of the wall panel parts to be measured in sequence to form a plurality of calibration combinations, and receiving a plurality of second images of the plurality of calibration combinations acquired by the imaging device; wherein the calibration block is a cylinder, and a flat plate with a calibration pattern is provided on the top of the calibration block;
[0061] In the specific implementation process, the calibration block refers to the component that is calibrated in image detection, such as Figure 5 As shown, the calibration block includes a plate with a recognizable calibration pattern, a cylinder, and a reference seat matched with the cylinder; wherein the bottom surface of the cylinder is parallel to the top surface of the plate, the bottom surface of the cylinder is perpendicular to the axis of the cylinder, the hole axis of the reference seat is perpendicular to its bottom surface, the calibration pattern on the plate is used to subsequently determine the conversion relationship between coordinate systems, the cylinder is used to insert the corresponding reference hole, and the reference seat is used to determine the coordinates of the points on the calibration pattern. The calibration block in this embodiment is composed of a plate with a black and white checkerboard pattern and a cylinder perpendicular to the plate, the diameter of the cylinder is D, which matches the reference hole of the wall panel part to be measured; the calibration block is also equipped with a reference seat, which is a square as a whole, and has a hole with a diameter of D in the center perpendicular to the upper and lower surfaces.
[0062] Specifically, calibration blocks of corresponding sizes are inserted into multiple reference holes of the wall panel parts to be measured in sequence, and the whole formed by the calibration blocks and the wall panel parts to be measured is the calibration combination; the controller controls the imaging device to take a picture of each calibration combination to obtain a second image corresponding to each calibration combination.
[0063] As an optional implementation, the calibration pattern is a black and white checkerboard pattern.
[0064] In the specific implementation process, the calibration pattern is a recognizable pattern array with a fixed spacing, which can be a black and white checkerboard, black and white solid dots, etc.; this embodiment selects a black and white checkerboard pattern as the calibration pattern.
[0065] S30: Mapping part features in the digital model of the wall panel part to be measured into a camera coordinate system according to the first image and the plurality of the second images to obtain mapping features; wherein the camera coordinate system is established based on the second image;
[0066] In the specific implementation process, the first image and the second image are both acquired based on the world coordinate system, and the subsequent detection steps need to be based on the camera coordinate system. The conversion relationship between the world coordinate system and the camera coordinate system can be obtained by calibrating the second image to establish the camera coordinate system. The relative relationship between the camera coordinate system and the world coordinate system is fixed: the Z axis of the camera coordinate system is collinear with the Z axis of the world coordinate system, the XY plane of the camera coordinate system is parallel to the XY plane of the world coordinate system, and the XY plane of the world coordinate system is a horizontal platform. The first image and the second image are converted from the world coordinate system to the camera coordinate system, so that the part features of the wall panel parts to be tested in the first image and the second image are mapped to the camera coordinate system to obtain the mapping features.
[0067] As an optional implementation, the step of mapping the part features in the digital model of the wall panel part to be measured to the camera coordinate system according to the first image and the plurality of the second images to obtain the mapping features includes:
[0068] Obtaining calibration coordinate values of a plurality of calibration blocks through a plurality of the second images;
[0069] Obtaining the hole center coordinate value of each reference hole in the first image through the multiple calibration coordinate values;
[0070] According to the hole center coordinate value, the part feature is mapped to the camera coordinate system to obtain the mapping feature.
[0071] In the specific implementation process, before the detection, the positional relationship between the coordinates of the three points in the calibration pattern of the calibration block and its outer contour is obtained by an image measuring instrument, that is, the transformation formula from the coordinates of the three points in the calibration pattern to the hole center of the corresponding reference hole is obtained. Three calibration points are selected in the calibration pattern in each second image, and the calibration coordinate values of the three calibration points are converted to obtain the hole center coordinate values of the corresponding reference hole, so as to obtain the hole center coordinate values of each reference hole. The part features extracted from the digital model of the wall panel parts are mapped to the camera coordinate system as a whole according to the corresponding relationship between the center coordinates of the reference holes to obtain the mapping features.
[0072] Specifically, the distance from the upper surface of the calibration block to the lower surface of the cylinder of the calibration block is recorded as Δz. Place the reference block on the platform of the image measuring instrument, measure the coordinates (x0, y0) of the center of its hole, keep the position of the reference block unchanged, insert the calibration block into it, and then use the image measuring instrument to measure the grid points on the black and white checkerboard pattern on its plate. Figure 6 Taking the 3*4 chessboard in as an example, 6 grid points can be extracted. The point in the lower left corner is the origin O, and its coordinates under the image measuring instrument are (x1, y1), the adjacent point on its left is P, and the coordinates are (x2, y2), and the adjacent point above is Q, and the coordinates are (x3, y3). Since the pattern is not symmetrical, no matter what posture is measured, according to the same selection basis, O, P, and Q always correspond to the same point on the pattern. The calibration block coordinate system is established with O, P, and Q. O is the origin, OP is the X-axis, OQ is the Y-axis, OP is perpendicular to OQ, and the straight line passing through point O and perpendicular to the OPQ plane downward is the Z-axis. The downward direction is the positive direction of the Z-axis, then the coordinates of (x0, y0) in the OPQ calibration block coordinate system are Since the calibration block is a rigid body, the geometric dimensions on it are constant. No matter what posture is used for measurement, the coordinates will remain unchanged. When measuring, the world coordinate system is established on a horizontal platform, and the Z axis is in the same direction as the Z axis of the calibration block. Therefore, when the new OPQ coordinates (x1′, y1′), (x2′, y2′), (x3′, y3′) are obtained in the new world coordinate system, we have:
[0073]
[0074]
[0075] Note: (x1-x0)(x2-x0)+(y1-y0)(y2-y0)=S
[0076] (x1-x0)(x3-x0)+(y1-y0)(y3-y0)=P, we can find the coordinates of the hole center in the new world coordinate system:
[0077]
[0078] By inserting calibration blocks into different reference holes, the center coordinates A, B, and C of no less than three reference holes are obtained. The center coordinates A0, B0, and C0 of three reference holes are selected from the digital model of the wall panel parts to be measured. The rigid body transformation matrix T from A0, B0, and C0 to A, B, and C is solved to satisfy A=TA0, B=TB0, and C=TC0. For any point M0 on the digital model, its mapping in the world coordinate system is TM0. The camera projection matrix T can be obtained by camera calibration. cam, this matrix can map points in the world coordinate system to the camera coordinate system. For any point M0 on the logarithmic module, its mapping in the camera coordinate system can be obtained. cam TM0. According to this method, the part features of the digital model of the wall panel part to be measured are mapped into the camera coordinate system to obtain the mapping features.
[0079] S40: Obtaining feature errors of the wall panel parts to be measured according to the mapping features and the first image.
[0080] In the specific implementation process, Figure 7 As shown in the figure, due to the lens parallax, the reference hole and part of the side wall of the lower sinking area can be seen in the first image, which is difficult to detect in the traditional detection method. By comparing the part features in the first image with the part features in the standard part digital model in the mapping features, the feature error between the real part of the wall panel to be tested and the part digital model can be obtained. By exchanging the relationship between the two-dimensional images, the error between the part features of the real part and the standard digital model is obtained, which reduces the difficulty of detection and also avoids the error caused by the superposition of results obtained through multiple measurements in the past.
[0081] As an optional implementation manner, the step of obtaining the feature error of the wall panel part to be measured according to the mapping feature and the first image includes:
[0082] Projecting the mapping features onto the first image according to the camera parameter matrix to obtain projection features;
[0083] The feature error is obtained according to the first image and the projection feature.
[0084] In the specific implementation process, the mapping features are projected onto the first image according to the camera projection matrix to obtain the projection features of the part features of the digital model of the wall panel part to be measured; that is, Figure 8 As shown in the dotted box in , the contour boundary of the part feature of the digital model mapped to the camera coordinate system is projected point by point onto the two-dimensional image; the feature error is obtained based on the feature difference between the projection and the two-dimensional image.
[0085] As an optional implementation manner, the step of obtaining the feature error according to the first image and the projection feature includes:
[0086] Extracting edge features on the first image according to the projection features; wherein the projection features include a plurality of projection points;
[0087] According to the edge feature and the projection feature, obtaining a pixel error between each of the projection points and the edge feature;
[0088] The feature error is obtained according to the plurality of pixel errors.
[0089] In the specific implementation process, the production and processing factors of the wall panel parts to be tested will inevitably make the physical object and the digital model of the part not completely consistent, so the projection features (part features in the digital model) will not completely overlap with the features in the first image (part features in the physical object). In the vicinity of the projection features, the edge features of the first image are extracted, and the pixel distance from the edge features to the projection features is calculated to obtain the feature error.
[0090] Specifically, taking each projection point in the projection feature as the center of the circle, a circular area of n pixels is delineated near it, and the edge is extracted in this area using an edge operator. The point in this area closest to the projection point is found, and its Euclidean distance is used as the pixel error of this position.
[0091] As an optional implementation manner, the step of obtaining the feature error according to the plurality of pixel errors includes:
[0092] The pixel error corresponding to each of the projection points is converted into a physical distance by using a camera parameter matrix to obtain a plurality of first characteristic errors;
[0093] The characteristic error is obtained according to a plurality of the first characteristic errors.
[0094] In the specific implementation process, the pixel error is converted into physical distance through the camera parameter matrix to obtain the conversion coefficient. The product of the pixel distance of the point and the coefficient is the actual error at the point, which is the first characteristic error. The first characteristic error corresponding to each characteristic point is calculated, and its set is the characteristic error between the actual wall panel part to be tested and the digital model of the part.
[0095] Specifically, let the coordinates of the projection point be (u, v), and the coordinates of the corresponding digital model point be (x M ,y M , z M ), select a point near it (x M ′,y M ′,z M ), calculate the coordinates of its projection point as (u′, v′), then the conversion factor from pixel distance to actual physical distance is Multiplying the pixel distance by this coefficient gives the actual error at that point.
[0096] It should be understood that the above is only an example and does not constitute any limitation to the technical solution of the present application. Those skilled in the art can make settings based on needs in actual applications and no limitation is made here.
[0097] It is not difficult to find from the above description that the present embodiment uses simple equipment such as imaging equipment and calibration blocks to obtain the conversion relationship between two-dimensional images, so that the part features in the digital model are projected onto the two-dimensional image of the actual part, and then the error between the part features of the actual part and the standard digital model is obtained, thereby reducing the number and complexity of the detection equipment; at the same time, the present application method has no strict requirements on the placement of the parts to be tested, and the actual position of the parts can be quickly obtained through the calibration block for detection; further, the entire wall panel part can be measured through only a small number of pictures, which reduces the difficulty of detection, avoids the errors caused by obtaining results through multiple measurements in the past, and improves the accuracy of detection.
[0098] Reference Figure 3 Based on the same inventive concept, an embodiment of the present application further provides a wall panel parts detection system, wherein the detection system is applied to a controller of a measuring device; wherein the measuring device further includes a horizontal surface, a calibration block and an imaging device, including:
[0099] A first image acquisition module is used to receive a first image of the wall panel part to be measured acquired by the imaging device; wherein the wall panel part to be measured is arranged on the horizontal surface, and the wall panel part to be measured includes at least three reference holes;
[0100] The second image acquisition module is used to control the calibration block to be inserted into each of the reference holes of the wall panel parts to be measured in sequence to form a plurality of calibration combinations, and receive a plurality of second images of the plurality of calibration combinations collected by the imaging device; wherein the calibration block is a cylinder, and a flat plate with a calibration pattern is provided on the top of the calibration block;
[0101] A mapping feature acquisition module, used to map the part features in the digital model of the wall panel part to be measured to a camera coordinate system according to the first image and the plurality of the second images, so as to obtain mapping features; wherein the camera coordinate system is established based on the second image;
[0102] The feature error acquisition module is used to obtain the feature error of the wall panel part to be measured according to the mapping feature and the first image.
[0103] It should be noted that each module in the wall panel parts detection system in this embodiment corresponds one-to-one to each step in the wall panel parts detection method in the aforementioned embodiment. Therefore, the specific implementation of this embodiment can refer to the implementation of the aforementioned wall panel parts detection method, which will not be repeated here.
[0104] In addition, in one embodiment, an embodiment of the present application further provides a computer device, which includes a processor, a memory, and a computer program stored in the memory, and the computer program implements the steps of the method in the aforementioned embodiment when executed by the processor.
[0105] In addition, in one embodiment, an embodiment of the present application further provides a computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method in the aforementioned embodiment are implemented.
[0106] In some embodiments, the computer readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or various devices including one or any combination of the above memories. The computer may be various computing devices including intelligent terminals and servers.
[0107] In some embodiments, executable instructions may be in the form of a program, software, software module, script or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment.
[0108] As an example, executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file that stores other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files storing one or more modules, subroutines, or code portions).
[0109] By way of example, executable instructions may be deployed to be executed on one computing device, or on multiple computing devices located at one site, or on multiple computing devices distributed across multiple sites and interconnected by a communication network.
[0110] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
[0111] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0112] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory / random access memory, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a multimedia terminal device (which can be a mobile phone, a computer, a television receiver, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0113] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A method for detecting wall panel parts. It is characterized in that The detection method is applied to a controller of a measuring device; wherein the measuring device also includes a horizontal platform, a calibration block and an imaging device, and includes the following steps: Receiving a first image of a wall panel part to be measured captured by the imaging device; wherein the wall panel part to be measured is arranged on the horizontal surface, and the wall panel part to be measured includes at least three reference holes; Controlling the calibration block to be inserted into each of the reference holes of the wall panel parts to be measured in sequence to form a plurality of calibration combinations, and receiving a plurality of second images of the plurality of calibration combinations acquired by the imaging device; wherein the calibration block is a cylinder, and a flat plate with a calibration pattern is provided on the top of the calibration block; According to the first image and the plurality of the second images, the part features in the digital model of the wall panel part to be measured are mapped into the camera coordinate system to obtain the mapping features; wherein the camera coordinate system is established based on the second image; The feature error of the wall panel part to be measured is obtained according to the mapping feature and the first image.
2. The wall panel parts detection method as claimed in claim 1, It is characterized in that The step of mapping the part features in the digital model of the wall panel part to be measured to the camera coordinate system according to the first image and the plurality of the second images to obtain the mapping features comprises: Obtaining calibration coordinate values of a plurality of calibration blocks through a plurality of the second images; Obtaining the hole center coordinate value of each reference hole in the first image through the multiple calibration coordinate values; According to the hole center coordinate value, the part feature is mapped to the camera coordinate system to obtain the mapping feature.
3. The wall panel parts detection method according to claim 1, It is characterized in that The step of obtaining the feature error of the wall panel part to be measured according to the mapping feature and the first image comprises: Projecting the mapping features onto the first image according to the camera parameter matrix to obtain projection features; The feature error is obtained according to the first image and the projection feature.
4. The wall panel parts detection method as claimed in claim 3, It is characterized in that The step of obtaining the feature error according to the first image and the projection feature comprises: Extracting edge features on the first image according to the projection features; wherein the projection features include a plurality of projection points; According to the edge feature and the projection feature, obtaining a pixel error between each of the projection points and the edge feature; The feature error is obtained according to the plurality of pixel errors.
5. The wall panel parts detection method as claimed in claim 4, It is characterized in that The step of obtaining the feature error according to the plurality of pixel errors comprises: The pixel error corresponding to each of the projection points is converted into a physical distance by using a camera parameter matrix to obtain a plurality of first characteristic errors; The characteristic error is obtained according to a plurality of the first characteristic errors.
6. The wall panel parts detection method as claimed in claim 1, It is characterized in that The calibration pattern is a black and white checkerboard pattern.
7. The wall panel parts detection method as claimed in claim 1, It is characterized in that Before the step of controlling the imaging device to measure the wall panel part to be measured and obtaining the first image, the method further includes: The internal parameters and external parameters of the imaging device are calibrated.
8. A wall panel parts detection system, It is characterized in that The detection system is applied to the controller of the measuring device; wherein the measuring device also includes a horizontal platform, a calibration block and an imaging device, including: A first image acquisition module is used to receive a first image of the wall panel part to be measured acquired by the imaging device; wherein the wall panel part to be measured is arranged on the horizontal surface, and the wall panel part to be measured includes at least three reference holes; The second image acquisition module is used to control the calibration block to be inserted into each of the reference holes of the wall panel parts to be measured in sequence to form a plurality of calibration combinations, and receive a plurality of second images of the plurality of calibration combinations collected by the imaging device; wherein the calibration block is a cylinder, and a flat plate with a calibration pattern is provided on the top of the calibration block; A mapping feature acquisition module, used to map the part features in the digital model of the wall panel part to be measured to a camera coordinate system according to the first image and the plurality of the second images, so as to obtain mapping features; wherein the camera coordinate system is established based on the second image; The feature error acquisition module is used to obtain the feature error of the wall panel part to be measured according to the mapping feature and the first image.
9. A computer device, It is characterized in that The computer device comprises a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the method according to any one of claims 1 to 7.
10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, and the processor executes the computer program to implement the method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Monocular vision-based detection method for detecting spatial position of part
CN112258455A
2D (two-dimensional) measuring device for wallboard parts and image acquisition method
CN116839484A
Part form and position error detection method and system based on image processing
CN118297942A
Double-station camera automatic calibration equipment
CN218181542U
