Method, device and system for detecting edge plate perforation defects
By acquiring top and side view images of the side plate, image processing technology is used to automatically detect burrs, height, diameter, and spacing of holes in the side plate, solving the problem of easy omissions during manual inspection and improving detection efficiency and accuracy.
Patent Information
- Application Number
- CN202411287470.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-13
- Publication Date
- 2026-02-13
- Estimated Expiration
- 2044-09-13
AI Technical Summary
In existing technologies, manual inspection of perforation defects in side plates is prone to omissions and has low production efficiency.
By acquiring top and side view images of the side plate, image processing technology is used to detect whether the burrs, height, diameter, and spacing of the holes in the side plate are up to standard, and defects are automatically identified.
It enables automatic identification of defects in side plate holes without manual inspection, improving detection efficiency and accuracy and reducing missed detections.
Smart Images

Figure CN118937341B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of image recognition and defect detection, in particular to a method and device for detecting defects of a side plate perforation, a computer program product and a defect detection system. BACKGROUND
[0002] The side plate at both ends of an air conditioner evaporator and condenser has a perforated flange on the top for fixing a copper pipe. However, burrs are easily generated around the perforation in the process of manufacturing the side plate sheet metal. If the size of the perforation, the height and angle of the flange, and the perforation spacing do not meet the rules, the copper pipe will be scratched or even directly broken during the process of inserting and assembling. If the scratched or broken copper pipe is assembled into the evaporator and condenser, the refrigeration and heating of the air conditioner will not be able to proceed normally, resulting in the air conditioner being scrapped. The existing solutions all improve the manufacturing performance of the side plate sheet metal in the stamping process. There is no good solution for detecting the perforated flange of the actual side plate, and the quality of the side plate is judged by manual sampling. Manual sampling detection will inevitably lead to missed detection or even false detection, and consumes a large amount of manpower and time, resulting in low production efficiency. SUMMARY
[0003] The main purpose of the present application is to provide a method and device for detecting defects of a side plate perforation, a computer program product and a defect detection system, so as to at least solve the problem of missed detection of the side plate perforation defect in manual inspection in the prior art.
[0004] In order to achieve the above-mentioned purpose, according to one aspect of the present application, a method for detecting defects of a side plate perforation is provided, the side plate includes a plurality of side plate holes, and the method includes: acquiring a top view image and a side view image of the side plate, the side plate including a side plate of an evaporator and a side plate of a condenser, the top view image being an image taken along a perforation direction, the side view image being an image taken along a side direction, the side direction being perpendicular to the perforation direction; detecting whether each side plate hole of the side plate has a burr according to the top view image; detecting whether the height and diameter of each side plate hole of the side plate are qualified according to the side view image, the height being the height difference between the top and bottom of the protrusion formed by the perforation of the side plate hole; in a case where any one of the burr existing in the side plate hole, the height of the side plate hole being unqualified, and the diameter of the side plate hole being unqualified is established, determining that the side plate hole has a defect; in a case where at least one side plate hole has a defect, determining that the side plate has a defect.
[0005] Optionally, the detecting whether burrs exist in each of the plate holes of the edge plate according to the top view image comprises: extracting a contour of each of the plate holes in the top view image to obtain a plurality of plate hole contours; subtracting a standard plate hole contour from the plurality of plate hole contours to obtain a plurality of difference contours, the standard plate hole contour being a contour of the plate hole without burrs; and determining that the plate hole with scattered spots in the difference contour has burrs.
[0006] Optionally, the detecting whether the height and diameter of each of the plate holes of the edge plate are qualified according to the side view image comprises: extracting an endpoint combined contour graph of each of the plate holes according to the side view image, the endpoint combined contour graph being a contour graph formed by sequentially connecting a plurality of endpoints of the plate hole, the endpoints including two top plate endpoints of a top portion of the plate hole and two bottom endpoints of a bottom portion of the plate hole in the side view image; calculating a distance between one of the top plate endpoints and a bottom straight line in each of the endpoint combined contour graphs to obtain a first height of each of the plate holes, and calculating a distance between the other of the top plate endpoints and the bottom straight line in each of the endpoint combined contour graphs to obtain a second height of each of the plate holes, the bottom straight line being a line connecting the two bottom endpoints of the bottom portion of the plate hole; and determining that the height of each of the plate holes is unqualified when the first height and / or the second height is not equal to a predetermined height.
[0007] Optionally, the detecting whether the height and diameter of each of the plate holes of the edge plate are qualified according to the side view image comprises: extracting an endpoint combined contour graph of each of the plate holes according to the side view image, the endpoint combined contour graph being a contour graph formed by sequentially connecting a plurality of endpoints of the plate hole, the endpoints including two top plate endpoints of a top portion of the plate hole and two bottom endpoints of a bottom portion of the plate hole in the side view image; calculating a distance between one of the top plate endpoints and a bottom straight line in each of the endpoint combined contour graphs to obtain a first height of each of the plate holes, and calculating a distance between the other of the top plate endpoints and the bottom straight line in each of the endpoint combined contour graphs to obtain a second height of each of the plate holes, the bottom straight line being a line connecting the two bottom endpoints of the bottom portion of the plate hole; and determining that the height of each of the plate holes is unqualified when the first height and / or the second height is not equal to a predetermined height.
[0008] Optionally, the method further comprises: extracting an end point combined contour of each of the edge plate holes from the side view image, the end point combined contour being a contour formed by sequentially connecting a plurality of end points of the edge plate hole, the end points including two top plate end points of a top portion of the edge plate hole and two bottom end points of a bottom portion of the edge plate hole in the side view image; calculating a distance between a first top plate end point and a bottom straight line in the end point combined contour to obtain a first height of the edge plate hole, calculating a distance between a second top plate end point and the bottom straight line in the end point combined contour to obtain a second height of the edge plate hole, the bottom straight line being a line connecting the two bottom end points of the bottom portion of the edge plate hole, the two top plate end points including the first top plate end point and the second top plate end point; calculating a length of a first inclined line in the end point combined contour to obtain a first length, calculating a length of a second inclined line in the end point combined contour to obtain a second length, the first inclined line being a contour line in the end point combined contour with the first top plate end point and one of the bottom end points as end points, the second inclined line being a contour line in the end point combined contour with the second top plate end point and one of the bottom end points as end points; calculating a first slope according to the first height and the first length, and calculating a second slope according to the second height and the second length; determining that the edge plate hole has a defect when the first slope and / or the second slope is not equal to a predetermined slope.
[0009] Optionally, the method further comprises: extracting an end point combined contour of each of the edge plate holes from the side view image, the end point combined contour being a contour formed by sequentially connecting a plurality of end points of the edge plate hole, the end points including two top plate end points of a top portion of the edge plate hole and two bottom end points of a bottom portion of the edge plate hole in the side view image; calculating a distance between a first top plate end point and a bottom straight line in the end point combined contour to obtain a first height of the edge plate hole, calculating a distance between a second top plate end point and the bottom straight line in the end point combined contour to obtain a second height of the edge plate hole, the bottom straight line being a line connecting the two bottom end points of the bottom portion of the edge plate hole, the two top plate end points including the first top plate end point and the second top plate end point; calculating a length of a first inclined line in the end point combined contour to obtain a first length, calculating a length of a second inclined line in the end point combined contour to obtain a second length, the first inclined line being a contour line in the end point combined contour with the first top plate end point and one of the bottom end points as end points, the second inclined line being a contour line in the end point combined contour with the second top plate end point and one of the bottom end points as end points; calculating a first slope according to the first height and the first length, and calculating a second slope according to the second height and the second length; determining that the edge plate hole has a defect when the first slope and / or the second slope is not equal to a predetermined slope.
[0010] Optionally, after determining that the edge plate has a defect, the method further comprises: recording a number of the edge plate hole corresponding to the defect.
[0011] According to another aspect of the present application, a device for detecting a perforation defect of a side plate is provided, the side plate comprising a plurality of side plate holes, the device comprising: an acquisition unit configured to acquire a top view image and a side view image of the side plate, the side plate comprising a side plate of an evaporator and a side plate of a condenser, the top view image being an image taken along a perforation direction, and the side view image being an image taken along a side direction perpendicular to the perforation direction; a first detection unit configured to detect whether each of the side plate holes of the side plate has burrs according to the top view image; a second detection unit configured to detect whether a height and a diameter of each of the side plate holes of the side plate are qualified according to the side view image, the height being a height difference between a top and a bottom of a protrusion formed by the perforation of the side plate hole; a first determination unit configured to determine that each of the side plate holes has a defect if any one of the following conditions is met: the side plate hole has burrs, the height of the side plate hole is unqualified, and the diameter of the side plate hole is unqualified; and a second determination unit configured to determine that the side plate has a defect if at least one of the side plate holes has a defect.
[0012] According to still another aspect of the present application, a computer program product is provided, comprising a computer program which, when executed by a processor, implements any of the methods described above.
[0013] According to yet another aspect of the present application, a defect detection system is provided, comprising a camera, one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs comprise instructions for performing any of the methods described above.
[0014] By applying the technical solution of the present application, in the detection of the perforation defect of the side plate, the top view image and the side view image of the side plate are acquired, whether each of the side plate holes has burrs is detected according to the top view image, and whether the height, the slope and the diameter of each of the side plate holes are qualified is detected according to the side view image, so that whether each of the side plate holes has a defect can be determined, and whether the side plate has a defect can be determined, without manual inspection, thereby solving the problem of missed detection in manual inspection of the perforation defect of the side plate in the prior art. BRIEF DESCRIPTION OF DRAWINGS
[0015] Figure 1 A hardware structure block diagram of a mobile terminal for performing a method for detecting a perforation defect of a side plate is shown according to an embodiment of the present application;
[0016] Figure 2 A flowchart of a method for detecting a perforation defect of a side plate is shown according to an embodiment of the present application;
[0017] Figure 3A top view image of a defect-free edge plate is shown according to an embodiment of the present application;
[0018] Figure 4 A side view image of a defect-free edge plate is shown according to an embodiment of the present application;
[0019] Figure 5 A top view image of an edge plate with burrs is shown according to an embodiment of the present application;
[0020] Figure 6 An end point combination profile is shown according to an embodiment of the present application;
[0021] Figure 7 A flowchart of another edge plate perforation defect detection method is shown according to an embodiment of the present application;
[0022] Figure 8 A structural block diagram of an edge plate perforation defect detection device is shown according to an embodiment of the present application.
[0023] Among them, the above-mentioned drawings include the following reference signs:
[0024] 102, processor; 104, memory; 106, transmission device; 108, input and output device. DETAILED DESCRIPTION
[0025] It should be noted that the embodiments and features in the present application can be combined with each other without conflict. The technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments. Obviously, the described embodiments are only a part of the embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor should be within the scope of protection of the present application.
[0026] In order to enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor should be within the scope of protection of the present application.
[0027] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate for the embodiments of this application described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0028] As described in the background section, manual inspection of perforation defects in side panels is prone to omissions in the prior art. To solve this technical problem, embodiments of this application provide a method, apparatus, computer program product, and defect detection system for detecting perforation defects in side panels.
[0029] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
[0030] The methods and embodiments provided in this application can be executed on a mobile terminal, computer terminal, or similar computing device. Taking running on a mobile terminal as an example, Figure 1 This is a hardware structure block diagram of a mobile terminal for a method of detecting perforation defects in a side panel according to an embodiment of the present invention. Figure 1 As shown, a mobile terminal may include one or more ( Figure 1 Only one is shown in the diagram. A processor 102 (which may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.) and a memory 104 for storing data are also shown. The mobile terminal may further include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the mobile terminal described above. For example, the mobile terminal may also include components that are more... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.
[0031] The memory 104 can be used to store computer programs, such as software programs of application software and modules, such as a computer program corresponding to the device information display method in the embodiments of the present application. The processor 102 executes various functional applications and data processing, i.e., implements the above method, by running the computer programs stored in the memory 104. The memory 104 can include a high-speed random access memory, and can further include a non-volatile memory, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories. In some examples, the memory 104 can further include memories remotely arranged with respect to the processor 102, which can be connected to the mobile terminal through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof. The transmission device 106 is used to receive or send data via a network. The specific examples of the above network can include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet in a wireless manner.
[0032] In the embodiments, a method for detecting a side plate perforation defect is provided, which is run on a mobile terminal, a computer terminal or a similar computing device. The side plate includes a plurality of side plate holes. It should be noted that the steps shown in the flowchart of the drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0033] Figure 2 FIG. 1 is a flowchart of a method for detecting a side plate perforation defect according to an embodiment of the present application. As shown in FIG. 1, the method includes the following steps: Figure 2
[0034] In step S201, a top view image and a side view image of a side plate are acquired. The side plate includes a side plate of an evaporator and a side plate of a condenser. The top view image is an image taken along a perforation direction, and the side view image is an image taken along a side direction. The side direction is perpendicular to the perforation direction.
[0035] In step S202, whether burrs exist in each side plate hole of the side plate is detected according to the top view image.
[0036] In step S203, whether the height and diameter of each side plate hole of the side plate are qualified is detected according to the side view image. The height is a height difference between a top and a bottom of a protrusion formed by the perforation of the side plate hole.
[0037] Step S204, in the case that any one of the burr of the edge plate hole, the unqualified height of the edge plate hole and the unqualified diameter of the edge plate hole is established, it is determined that the edge plate hole has defects;
[0038] Step S205, in the case that at least one edge plate hole has defects, it is determined that the edge plate has defects.
[0039] In the above detection of the edge plate hole defects, the method can detect whether each edge plate hole has defects and whether the edge plate has defects by acquiring the top view image and the side view image of the edge plate, detecting whether each edge plate hole of the edge plate has burrs through the top view image, and detecting whether the height, slope and diameter of each edge plate hole of the edge plate are qualified through the side view image, without manual inspection, thereby solving the problem of easy missed detection in the prior art.
[0040] It should be noted that when acquiring the top view image and the side view image of the edge plate of the evaporator and the edge plate of the condenser, the edge plate is placed horizontally, the edge plate of the air conditioner evaporator and the edge plate of the condenser are metal plates with two rows of perforations, and the image of the edge plate of the evaporator and the edge plate of the condenser includes the top view image as shown in Figure 3 Each circular hole in the figure represents a perforation on the edge plate. The normal edge plate perforation is a smooth circle in top view. The normal side view image of the edge plate is as shown in Figure 4 It should be noted that in the actual perforation process, the metal plate is penetrated and expanded, Figure 4 The HI, JK and other equal edge contours are curves, not straight lines.
[0041] In order to detect burr defects, in an alternative embodiment, the above step S202 includes:
[0042] Step S2021, extracting the contour of each edge plate hole in the top view image to obtain a plurality of edge plate hole contours;
[0043] Step S2022, subtracting a standard edge plate hole contour from the plurality of edge plate hole contours to obtain a plurality of difference contours, the standard edge plate hole contour being the contour of an edge plate hole without burrs;
[0044] Step S2023, determining that the edge plate hole with scattered spots in the difference contour has a burr.
[0045] In the above embodiments, as shown in Figure 3As shown, the edge of the perforation in the manufacturing process is smooth, if the perforation is immature or the material of the metal itself has problems, there will be metal extension or burr or deformation phenomenon caused by the perforation technology, which is called perforation burr defect. According to the top view of the edge plate, the image binarization processing is performed on the edge plate, and the image of the circular hole is extracted. As shown in Figure 5 As shown, A and B points in circle O are examples of obvious burrs. When the extracted circle O contour (edge plate hole contour) is inconsistent with the standard edge plate hole contour, the open and close operations of the image are used, that is, the standard edge plate hole contour is deducted from the multiple edge plate hole contours, and the resulting image is a non-pure color image with scattered spots, indicating that there is a burr defect.
[0046] In order to detect whether the height of the edge plate hole is qualified, in an optional embodiment, the above step S203 includes:
[0047] In step S2031, the end point combination contour graph of each edge plate hole is extracted according to the side view image, the end point combination contour graph is a contour graph formed by sequentially connecting multiple end points of the edge plate hole, and the end points include two top plate end points of the top of the edge plate hole and two bottom end points of the bottom of the edge plate hole in the side view image;
[0048] In step S2032, the distance between one top plate end point and the bottom straight line in each end point combination contour graph is calculated to obtain the first height of each edge plate hole, and the distance between the other top plate end point and the bottom straight line in each end point combination contour graph is calculated to obtain the second height of each edge plate hole, and the bottom straight line is the connecting line of the two bottom end points of the bottom of the edge plate hole.
[0049] In step S2033, the height of the edge plate hole is determined to be unqualified when the first height and / or the second height is not equal to the predetermined height.
[0050] In the above embodiment, as shown in Figure 4 The edge contour of the perforation HI, JK, etc. is arc-shaped, and the perforation itself has a certain height and width. In order to detect the above parameter indicators of the perforation, the perforation front (side) view of the edge plate is processed as follows to obtain the contour graph of the end point connecting line, which mainly solves the problem that the side of the HI, JK, etc. edge plate perforation is a curve which is not conducive to detection. Since in actual detection, the perforation indicators need to be concerned, the perforation front (side) view of the edge plate is processed as follows to obtain the contour graph of the end point connecting line, which mainly solves the problem that the side of the HI, JK, etc. edge plate perforation is a curve which is not conducive to detection. Figure 4 Taking the HIJKL contour of O1 in Figure 6 as an example, the end point connecting line is mapped to the end point combination contour HIJKL, that is, the curves such as HI and JK are converted into straight lines. The first height of the edge plate hole is FI, that is, the distance between the top plate end point I and the bottom straight line HK. Similarly, the distance between the top plate end point J and the bottom straight line HK can be calculated to obtain the second height. If the first height and the second height are equal to the predetermined height, the height of the edge plate hole is qualified, otherwise it is unqualified.
[0051] In order to detect whether the diameter of the side plate hole is qualified, in an optional embodiment, the step S203 further comprises:
[0052] In step S2034, an endpoint combination profile of each side plate hole is extracted from the side view image, the endpoint combination profile being a profile formed by sequentially connecting a plurality of endpoints of the side plate hole, the endpoints including two top plate endpoints of the top of the side plate hole and two bottom endpoints of the bottom of the side plate hole in the side view image;
[0053] In step S2035, the distance between the two top plate endpoints in each endpoint combination profile is calculated to obtain the diameter of each side plate hole;
[0054] In step S2036, it is determined that the diameter of the side plate hole is unqualified if the diameter of the side plate hole is not equal to the predetermined diameter.
[0055] In the above embodiment, the distance between the two top plate endpoints in each endpoint combination profile is calculated, i.e. Figure 6 The length of the line IJ is the diameter of the side plate hole, and the diameter of the side plate hole is equal to the predetermined diameter, so that the diameter of the side plate hole is qualified, otherwise unqualified.
[0056] In order to detect whether the side plate hole has an angle defect, in an optional embodiment, the method further comprises:
[0057] In step S301, an endpoint combination profile of each side plate hole is extracted from the side view image, the endpoint combination profile being a profile formed by sequentially connecting a plurality of endpoints of the side plate hole, the endpoints including two top plate endpoints of the top of the side plate hole and two bottom endpoints of the bottom of the side plate hole in the side view image;
[0058] In step S302, the distance between the first top plate endpoint and the bottom straight line in the endpoint combination profile is calculated to obtain a first height of the side plate hole, and the distance between the second top plate endpoint and the bottom straight line in the endpoint combination profile is calculated to obtain a second height of the side plate hole, the bottom straight line being a line connecting the two bottom endpoints of the bottom of the side plate hole, and the two top plate endpoints including the first top plate endpoint and the second top plate endpoint;
[0059] In step S303, the length of the first inclined line in the endpoint combination profile is calculated to obtain a first length, and the length of the second inclined line in the endpoint combination profile is calculated to obtain a second length, the first inclined line being a profile line in the endpoint combination profile with the first top plate endpoint and one bottom endpoint as endpoints, and the second inclined line being a profile line in the endpoint combination profile with the second top plate endpoint and one bottom endpoint as endpoints;
[0060] In step S304, a first slope is calculated according to the first height and the first length, and a second slope is calculated according to the second height and the second length;
[0061] Step S305: Determine that there is a defect in the side plate hole where the first slope and / or the second slope is not equal to the predetermined slope.
[0062] In the above implementation, for line segments HI and JK, according to Hough line detection, the slopes of the two types of lines are opposites of each other, and their lengths are equal, satisfying the characteristic of symmetry. That is, let the length of the standard side line segment be l, and the slope be the first slope k and the second slope -k. Specifically: for non-horizontal lines, using slope k as a characteristic, one type of line is recorded as (ln, kn) (n = 1, 2, ..., N), where ln is the length of the line segment, kn is the slope of each line segment, and N is the number of perforations in the side plate; using slope -k as a characteristic, another type of line is recorded as (lm, -km) (m = 1, 2, ..., N), where lm is the length of the line segment, -km is the slope of each line segment, and N is the number of perforations in the side plate. Ideally, only two types of slopes exist, i.e., slope kn = |-km|. In actual manufacturing, when the manufactured perforations do not meet the standards, the length l and the slope k will not meet the default requirements. When the above (ln, kn) and (lm, -km) can simultaneously satisfy kn=|-km|=k, n=m, that is, the slope and the number of holes both meet the requirements, it means that the angle of the side plate hole meets the manufacturing process. If any side plate hole does not meet the requirements, there is a defect.
[0063] To address the issue of defects in the spacing between the side plate holes, in one optional implementation, the method further includes:
[0064] Step S401: Extract the endpoint combination contour map of each side plate hole based on the side view image. The endpoint combination contour map is a contour map formed by connecting multiple endpoints of the side plate hole in sequence. The endpoints include the two top plate endpoints of the top of the side plate hole and the two bottom endpoints of the bottom of the side plate hole in the side view image.
[0065] Step S402: Calculate the minimum distance between two adjacent combined contour maps to obtain the distance between multiple perforations;
[0066] Step S403: If the distance between any two perforations is not equal to the predetermined distance, it is determined that there is a defect in the side plate.
[0067] In the above embodiments, with Figure 4 Using the length information and y-coordinate of KL as features, the straight line segments with equal y-coordinates are numbered sequentially. Specifically, when there are N perforations in the side plate and the actual spacing is s, under normal circumstances, the numbering of the above straight line segments is [1,2,...,N-1], where N-1 represents the spacing between the N-1th perforation and the Nth perforation. When the length is not s (in actual operation, it can be set to near the threshold), it is determined that there is a defect in the side plate.
[0068] In order to locate the defect position, in an optional embodiment, after determining that the edge plate has a defect, the above method further comprises:
[0069] Step S501, record the number of the edge plate hole corresponding to the defect.
[0070] In the above embodiment, the number of the edge plate hole corresponding to the existing defect is recorded, and if the edge plate hole spacing has a defect, the numbers of the two edge plate holes corresponding to the spacing are recorded in order to locate the defect position.
[0071] In order to enable those skilled in the art to more clearly understand the technical solutions of the present application, the implementation process of the edge plate perforation defect detection method of the present application will be described in detail below in conjunction with specific embodiments.
[0072] The present embodiment relates to a specific edge plate perforation defect detection method, as shown in Figure 7 , comprising the following steps:
[0073] S1, take an image of the two-device edge plate:
[0074] S11, take an overhead view of the edge plate: the edge plate is placed horizontally. The two-device edge plate is a metal plate with two rows of perforations. Taking an image of the two-device edge plate includes taking an overhead view of the edge plate as shown in Figure 1 , in which each circular hole in the figure represents a perforation on the edge plate. The overhead view of a normal edge plate perforation is a smooth circle.
[0075] S12, take a front (side) view of the edge plate: the edge plate is placed horizontally. The circular holes of the edge plate can be used as the front (side) view direction, and a normal two-device edge plate front (side) view is taken as shown in Figure 2 . It should be noted that in the actual perforation process, the metal plate is stretched and penetrated, Figure 2 , the HI, JK, and other edge contours are curves, not straight lines.
[0076] S2, edge plate perforation defect detection:
[0077] S21, burr detection of edge plate perforation:
[0078] As shown in Figure 1 , the perforation of the two-device edge plate in the manufacturing process is in a qualified state of forming a smooth perforation. If there is a problem of immaturity of the metal perforation process or the material quality of the metal itself, there will be metal stretching or burr or deformation phenomenon caused by the perforation technology at the edge of the perforation, which is called perforation burr defect.
[0079] According to the taken overhead view of the edge plate, the image of the edge plate is binarized, and the image of the circular hole is extracted. As shown in Figure 3The example of points A and B in circle O shows obvious burrs. When the extracted circle O contour is inconsistent with the standard edge plate perforation, the image obtained by opening and closing operations is a non-solid color image with scattered spots, indicating the presence of burr defects.
[0080] Performance testing of perforated parameters in S22 side plate.
[0081] like Figure 4 As shown, according to the description in S12, the edge contours of perforations such as HI and JK are arc-shaped, and the perforations themselves have a certain height and width. In order to facilitate the detection of the above parameters of the perforations, the front (side) view of the perforations on the side plate is processed as follows:
[0082] S221 Obtains the outline of the lines connecting the endpoints of the test graph:
[0083] Obtaining the contour diagram of the endpoint connection line is mainly to address the issue that the curved sides of perforations in side plates such as HI and JK are unfavorable for inspection. In actual inspection, various perforation parameters need to be considered. Figure 2 Taking the HIJKL contour of O1 as an example, it is mapped to Figure 4 The endpoints are connected to form a polygonal line profile HIJKL, which converts curves such as HI and JK into straight lines. These indicators are the width IJ of the perforation, the height FI of the perforation, and the spacing KL of the perforations. Among them, the height FI of the perforation reflects the angular information in the perforation manufacturing process. In this invention, it is converted into a line segment HI and its slope. Based on the length of the line segment HI and its slope in the coordinate system, the value of FI is calculated, which reflects the manufacturing process performance and defects of the perforation.
[0084] S222 perforation process defect detection:
[0085] S2221 Numbers the straight segments and checks the width of the perforations:
[0086] According to Hough line detection, it can be detected that Figure 4 This process involves collecting information on all straight lines, their slopes, and lengths. Each line in each category is numbered. Specifically, when a line of the same type (IJ) is detected, the line segments with equal y-coordinates are numbered sequentially based on their length and y-coordinate. Furthermore, when there are N perforations of radius r on the side panel, under normal circumstances, the numbering of these line segments is [1,2,...,N], and their length is always r. If a line segment of this type has a length other than r (in practice, this can be set near a threshold), the corresponding line number is output, indicating the location of the non-compliant perforation.
[0087] S2222 performs linear numbering and detects the distance between perforations:
[0088] Similarly to S2221, withFigure 4 The length information of the middle KL and the y coordinate are features, the straight line segments with equal y coordinates are sequentially numbered, and the specific numbering is: and when there are N perforations in the edge plate and the actual interval is s, under normal circumstances, the numbering of the above straight line segments is [1, 2,..., N-1], where N-1 represents the interval between the N-1th perforation and the Nth perforation, when the length is not s (the actual operation can be set to the threshold value), the corresponding straight line number is output, that is, the position of the edge hole interval that does not meet the requirements is output.
[0089] S2223 performs straight line numbering and detects the height of the perforation:
[0090] S22231 straight line segment numbering:
[0091] For HI and JK line segments (according to S221, the height and angle information of the perforation can be reflected), according to the Hough straight line detection, the slopes of the two types of straight lines are opposite numbers and the lengths are equal, which satisfy the symmetry feature, that is, the length of the standard side surface straight line segment is l, the slope is k, -k. Specifically: for non-horizontal straight lines, take the slope k as a feature, record a type of straight line as (ln, kn) (n = 1, 2,..., N), where ln is the length of the straight line segment, kn is the slope of each straight line segment, and N is the number of edge plate perforations; take the slope -k as a feature, record a type of straight line as (lm, -km) (m = 1, 2,..., N), where lm is the length of the straight line segment, -km is the slope of each straight line segment, and N is the number of edge plate perforations.
[0092] S22232 perforation height and angle detection:
[0093] In S22232, under ideal conditions, there are only two types of slopes, that is, the slope kn = |-km|, and there is a type of straight line length ln = lm. In actual manufacturing, when the manufactured perforation does not meet the standard, the length l and the slope k do not meet the default requirements, when the above (ln, kn) and (lm, -km) can simultaneously satisfy ln = lm, kn = |-km| = k, n = m, that is, the slope, length and number information all meet the requirements, it indicates that the angle height of the perforation meets the manufacturing process. Otherwise, output the corresponding n, m number, that is, the position that does not meet the standard.
[0094] S3 completes the edge plate perforation detection:
[0095] According to the operations in S2, the width, interval and perforation angle height of the edge plate perforation are detected, and the edge plate perforation is detected according to the parameters and numbers and the fault position is output. When all the indicators in S22 meet the requirements, it means that the manufacturing meets the standard.
[0096] It is noted that the steps illustrated in the flowcharts of the drawings can be performed in a computer system such as a set of computer-executable instructions executed by a computer system and while a logical progression of steps is shown in the flowcharts, it is possible that some of the steps depicted therein can be performed in an order other than that which is shown.
[0097] The embodiment of the present application further provides a device for detecting a perforation defect of a side plate. It is to be noted that the device for detecting a perforation defect of a side plate can be used to execute the method for detecting a perforation defect of a side plate provided by the embodiment of the present application. The device is used to realize the above-mentioned embodiment and preferred implementation, and the description of which has been made above. As used below, the term "module" can be a combination of software and / or hardware that realizes a predetermined function. Although the device described in the following embodiment is preferably realized in software, the realization of hardware or a combination of software and hardware is also possible and contemplated.
[0098] The device for detecting a perforation defect of a side plate provided by the embodiment of the present application is described below. The side plate includes a plurality of side plate holes.
[0099] Figure 8 is a structural block diagram of the device for detecting a perforation defect of a side plate according to the embodiment of the present application. As shown in Figure 8 , the device includes:
[0100] The acquisition unit 10 is configured to acquire a top view image and a side view image of a side plate. The side plate includes a side plate of an evaporator and a side plate of a condenser. The top view image is an image taken along a perforation direction, and the side view image is an image taken along a side direction. The side direction is perpendicular to the perforation direction.
[0101] The first detection unit 20 is configured to detect whether each side plate hole of the side plate has a burr according to the top view image.
[0102] The second detection unit 30 is configured to detect whether the height and diameter of each side plate hole of the side plate are qualified according to the side view image. The height is the height difference between the top and bottom of the protrusion formed by the perforation of the side plate hole.
[0103] The first determination unit 40 is configured to determine that the side plate hole has a defect if any one of the following conditions is met: the side plate hole has a burr, the height of the side plate hole is unqualified, and the diameter of the side plate hole is unqualified.
[0104] The second determination unit 50 is configured to determine that the side plate has a defect if at least one side plate hole has a defect.
[0105] The device for detecting the perforation defects of the edge plate can detect whether each edge plate hole has a burr through the top view image, detect whether the height, slope and diameter of each edge plate hole are qualified through the side view image, and thus determine whether each edge plate hole has a defect and whether the edge plate has a defect, without manual inspection, so as to solve the problem of missed detection in the prior art.
[0106] In order to detect the burr defect, in an optional embodiment, the first detection unit includes:
[0107] The first detection module is configured to extract the contour of each edge plate hole in the top view image to obtain a plurality of edge plate hole contours.
[0108] The second detection module is configured to subtract a standard edge plate hole contour from the plurality of edge plate hole contours to obtain a plurality of difference contours, the standard edge plate hole contour being the contour of an edge plate hole without a burr.
[0109] The third detection module is configured to determine that an edge plate hole with scattered spots in the difference contour has a burr.
[0110] In the above embodiment, as shown in Figure 3 In the manufacturing process of the perforation of the edge plate, the qualified state is to form a smooth perforation. If there is a problem of immaturity of the metal perforation process or the material of the metal itself, there will be metal extension or burr or deformation phenomenon caused by the perforation technology at the edge of the perforation, which is referred to as perforation burr defect. According to the shot top view of the edge plate, the image of the circular hole is extracted after image binarization processing. As shown in Figure 5 The points A and B in the circle O are examples of obvious burrs. When the extracted contour of the circle O (the contour of the edge plate hole) is inconsistent with the standard edge plate hole contour, the open and closed operations of the image are used, that is, the standard edge plate hole contour is subtracted from the plurality of edge plate hole contours, and the result image is a non-pure color image and scattered spots, which indicates that there is a burr defect.
[0111] In order to detect whether the height of the edge plate hole is qualified, in an optional embodiment, the second detection unit includes:
[0112] The fourth detection module is configured to extract an endpoint combination contour of each edge plate hole according to the side view image, the endpoint combination contour being a contour formed by sequentially connecting a plurality of endpoints of the edge plate hole, the endpoints including two top plate endpoints of the top of the edge plate hole and two bottom endpoints of the bottom of the edge plate hole in the side view image.
[0113] The fifth detection module is used to calculate the distance between one top plate endpoint and the bottom straight line in the contour diagram of each endpoint combination to obtain the first height of each side plate hole, and to calculate the distance between another top plate endpoint and the bottom straight line in the contour diagram of each endpoint combination to obtain the second height of each side plate hole. The bottom straight line is the line connecting the two bottom endpoints of the bottom of the side plate hole.
[0114] The sixth detection module is used to determine that the height of the side plate hole is unqualified if the first height and / or the second height is not equal to the predetermined height.
[0115] In the above embodiments, such as Figure 4 As shown, the edge contours of perforations in HI, JK, etc., are arc-shaped, and the perforations themselves have a certain height and width. To facilitate the detection of the above parameters of the perforations, the front (side) view of the perforation on the side plate is processed as follows to obtain the contour diagram of the endpoint connection line. This mainly addresses the problem that the curved side surface of the perforations in HI, JK, etc., is not conducive to detection. Since in actual detection, various perforation parameters need to be considered... Figure 4 Taking the HIJKL contour of O1 as an example, it is mapped to Figure 6 The endpoints are connected, and the corresponding endpoint combination contour HIJKL is obtained. That is, the curves such as HI and JK are converted into straight lines. Then the first height of the side plate hole is FI, which is the distance between the top plate endpoint I and the bottom straight line HK. Similarly, the distance between the top plate endpoint J and the bottom straight line HK can be calculated to obtain the second height. If the first height and the second height are equal to the predetermined height, then the height of the side plate hole is qualified; otherwise, it is unqualified.
[0116] In an optional embodiment, to detect whether the diameter of the side plate hole is qualified, the second detection unit further includes:
[0117] The seventh detection module is used to extract the endpoint combination contour map of each side plate hole based on the side view image. The endpoint combination contour map is a contour map formed by connecting multiple endpoints of the side plate hole in sequence. The endpoints include the two top plate endpoints of the side plate hole at the top and the two bottom endpoints of the side plate hole at the bottom in the side view image.
[0118] The eighth detection module is used to calculate the distance between the two top plate endpoints in the contour diagram of each endpoint combination, and to obtain the diameter of each side plate hole;
[0119] The ninth detection module is used to determine whether the diameter of the side plate hole is unqualified if it is not equal to the predetermined diameter.
[0120] In the above implementation, the distance between the two top plate endpoints in the contour diagram of each endpoint combination is calculated, i.e. Figure 6 The length of IJ is the diameter of the side plate hole. If the diameter of the side plate hole is equal to the predetermined diameter, then the diameter of the side plate hole is qualified; otherwise, it is unqualified.
[0121] In order to determine whether the edge hole has an angle defect, in an optional embodiment, the device further comprises:
[0122] a third detection unit configured to extract an endpoint combination profile of each edge hole from the side view image, the endpoint combination profile being a profile formed by sequentially connecting a plurality of endpoints of the edge hole, the endpoints including two top plate endpoints of a top portion of the edge hole and two bottom endpoints of a bottom portion of the edge hole in the side view image;
[0123] a fourth detection unit configured to calculate a distance between a first top plate endpoint and a bottom straight line in the endpoint combination profile to obtain a first height of the edge hole, and calculate a distance between a second top plate endpoint and the bottom straight line in the endpoint combination profile to obtain a second height of the edge hole, the bottom straight line being a line connecting the two bottom endpoints of the bottom portion of the edge hole, and the two top plate endpoints including the first top plate endpoint and the second top plate endpoint;
[0124] a fifth detection unit configured to calculate a first length of a first inclined line in the endpoint combination profile to obtain a first length, and calculate a second length of a second inclined line in the endpoint combination profile to obtain a second length, the first inclined line being a profile line in the endpoint combination profile with the first top plate endpoint and one bottom endpoint as endpoints, and the second inclined line being a profile line in the endpoint combination profile with the second top plate endpoint and one bottom endpoint as endpoints;
[0125] a sixth detection unit configured to calculate a first slope according to the first height and the first length, and calculate a second slope according to the second height and the second length;
[0126] a seventh detection unit configured to determine that the edge hole has a defect when the first slope and / or the second slope is not equal to a predetermined slope.
[0127] In the above implementation, for line segments HI and JK, according to Hough line detection, the slopes of the two types of lines are opposites of each other, and their lengths are equal, satisfying the characteristic of symmetry. That is, let the length of the standard side line segment be l, and the slope be the first slope k and the second slope -k. Specifically: for non-horizontal lines, using slope k as a characteristic, one type of line is recorded as (ln, kn) (n = 1, 2, ..., N), where ln is the length of the line segment, kn is the slope of each line segment, and N is the number of perforations in the side plate; using slope -k as a characteristic, another type of line is recorded as (lm, -km) (m = 1, 2, ..., N), where lm is the length of the line segment, -km is the slope of each line segment, and N is the number of perforations in the side plate. Ideally, only two types of slopes exist, i.e., slope kn = |-km|. In actual manufacturing, when the manufactured perforations do not meet the standards, the length l and the slope k will not meet the default requirements. When the above (ln, kn) and (lm, -km) can simultaneously satisfy kn=|-km|=k, n=m, that is, the slope and the number of holes both meet the requirements, it means that the angle of the side plate hole meets the manufacturing process. If any side plate hole does not meet the requirements, there is a defect.
[0128] To address the issue of defects in the spacing between the side plate holes, in one optional embodiment, the above-mentioned device further includes:
[0129] The eighth detection unit is used to extract the endpoint combination contour map of each side plate hole based on the side view image. The endpoint combination contour map is a contour map formed by connecting multiple endpoints of the side plate hole in sequence. The endpoints include the two top plate endpoints of the top of the side plate hole and the two bottom endpoints of the bottom of the side plate hole in the side view image.
[0130] The ninth detection unit is used to calculate the minimum distance between two adjacent combined contour maps to obtain the distance between multiple perforations;
[0131] The tenth detection unit is used to determine the presence of defects in the side plate when the distance between any two perforations is not equal to the predetermined distance.
[0132] In the above embodiments, with Figure 4 Using the length information and y-coordinate of KL as features, the straight line segments with equal y-coordinates are numbered sequentially. Specifically, when there are N perforations in the side plate and the actual spacing is s, under normal circumstances, the numbering of the above straight line segments is [1,2,...,N-1], where N-1 represents the spacing between the N-1th perforation and the Nth perforation. When the length is not s (in actual operation, it can be set to near the threshold), it is determined that there is a defect in the side plate.
[0133] In an optional embodiment, to locate the defect, the above-mentioned device further includes:
[0134] A recording unit is configured to record the number of the edge plate hole corresponding to the defect after determining that the edge plate has the defect.
[0135] In the above embodiment, the number of the edge plate hole corresponding to the existing defect is recorded, and if the edge plate hole spacing has a defect, the numbers of the two edge plate holes corresponding to the spacing are recorded to locate the defect position.
[0136] The edge plate perforation defect detection device includes a processor and a memory, and the above-mentioned acquisition unit, first detection unit, second detection unit, first determination unit and second determination unit are all stored in the memory as program units, and the corresponding functions are realized by the processor executing the above-mentioned program units stored in the memory. The above-mentioned modules are located in the same processor; or the above-mentioned modules are located in different processors in any combination.
[0137] The processor includes a core, and the core calls the corresponding program unit from the memory. The core can be one or more, and the problem of easy missed detection in the prior art caused by manual inspection of edge plate perforation defects can be solved by adjusting the core parameters.
[0138] The memory can include a non-permanent memory in a computer readable medium, a random access memory (RAM) and / or a non-volatile memory such as a read-only memory (ROM) or a flash memory (flash RAM), and the memory includes at least one memory chip.
[0139] The embodiment of the present application provides a computer readable storage medium, which includes a stored program, wherein when the program runs, the computer readable storage medium controls the device where the computer readable storage medium is located to execute the edge plate perforation defect detection method.
[0140] Specifically, the edge plate perforation defect detection method includes:
[0141] In step S201, the top view image and the side view image of the edge plate are acquired, the edge plate includes the edge plate of the evaporator and the edge plate of the condenser, the top view image is an image taken along the perforation direction, the side view image is an image taken along the side direction, and the side direction is perpendicular to the perforation direction;
[0142] In step S202, whether the burr exists in each edge plate hole of the edge plate is detected according to the top view image;
[0143] In step S203, whether the height and the diameter of each edge plate hole of the edge plate are qualified is detected according to the side view image, and the height is the height difference between the top and the bottom of the protrusion formed by the perforation of the edge plate hole;
[0144] In step S204, if any one of the burr existing in the edge plate hole, the unqualified height of the edge plate hole and the unqualified diameter of the edge plate hole is established, it is determined that the edge plate hole has a defect.
[0145] Step S205, in the case that at least one of the side plate holes has defects, it is determined that the side plate has defects.
[0146] The embodiment of the present application provides a processor, which is used for running a program, wherein the processor implements the method for detecting side plate hole defects when the program is running.
[0147] Specifically, the method for detecting side plate hole defects comprises the following steps.
[0148] Step S201, an overhead view image and a side view image of a side plate are acquired, the side plate comprises a side plate of an evaporator and a side plate of a condenser, the overhead view image is an image captured along a hole direction, and the side view image is an image captured along a side direction, wherein the side direction is perpendicular to the hole direction;
[0149] Step S202, whether burrs exist in each side plate hole of the side plate is detected according to the overhead view image;
[0150] Step S203, whether the height and the diameter of each side plate hole of the side plate are qualified is detected according to the side view image, wherein the height is a height difference between a top and a bottom of a protrusion formed by hole punching of the side plate hole;
[0151] Step S204, in the case that any one of the following conditions is met, i.e., burrs exist in the side plate hole, the height of the side plate hole is unqualified, and the diameter of the side plate hole is unqualified, it is determined that the side plate hole has defects;
[0152] Step S205, in the case that at least one of the side plate holes has defects, it is determined that the side plate has defects.
[0153] The embodiment of the present application provides a defect detection system, which comprises a camera, a processor, a memory, and a program stored in the memory and capable of running on the processor, and the processor implements at least the following steps when the program is running:
[0154] Step S201, an overhead view image and a side view image of a side plate are acquired, the side plate comprises a side plate of an evaporator and a side plate of a condenser, the overhead view image is an image captured along a hole direction, and the side view image is an image captured along a side direction, wherein the side direction is perpendicular to the hole direction;
[0155] Step S202, whether burrs exist in each side plate hole of the side plate is detected according to the overhead view image;
[0156] Step S203, whether the height and the diameter of each side plate hole of the side plate are qualified is detected according to the side view image, wherein the height is a height difference between a top and a bottom of a protrusion formed by hole punching of the side plate hole;
[0157] Step S204, in the case that any one of the burrs existing in the edge plate hole, the height of the edge plate hole being unqualified, and the diameter of the edge plate hole being unqualified is established, it is determined that the edge plate hole has defects;
[0158] Step S205, in the case that at least one edge plate hole has defects, it is determined that the edge plate has defects.
[0159] The present application also provides a computer program product, when executed on a data processing device, is adapted to execute the program of initializing at least the following method steps:
[0160] Step S201, obtaining the top view image and the side view image of the edge plate, the edge plate including the edge plate of the evaporator and the edge plate of the condenser, the top view image being an image taken along the perforation direction, and the side view image being an image taken along the side direction, the side direction being perpendicular to the perforation direction;
[0161] Step S202, detecting whether the edge plate hole of the edge plate has burrs according to the top view image;
[0162] Step S203, detecting whether the height and diameter of each edge plate hole of the edge plate are qualified according to the side view image, the height being the height difference between the top and bottom of the protrusion formed by the perforation of the edge plate hole;
[0163] Step S204, in the case that any one of the burrs existing in the edge plate hole, the height of the edge plate hole being unqualified, and the diameter of the edge plate hole being unqualified is established, it is determined that the edge plate hole has defects;
[0164] Step S205, in the case that at least one edge plate hole has defects, it is determined that the edge plate has defects.
[0165] Obviously, those skilled in the art should understand that the above-mentioned modules or steps of the present application can be realized by a general computing device, which can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, which can be realized by program code executable by the computing device, so that they can be stored in the storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in different order, or they can be manufactured into individual integrated circuit modules, or multiple modules or steps can be manufactured into a single integrated circuit module. Thus, the present application is not limited to any specific combination of hardware and software.
[0166] Those skilled in the art will appreciate that embodiments of the application can be readily used as software, hardware, or a combination of software and hardware. In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.
[0167] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.
[0168] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.
[0169] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.
[0170] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.
[0171] The memory can include non-persistent memory, random access memory (RAM), and / or non-volatile memory, etc. in the form of a computer-readable medium, such as read only memory (ROM) or flash memory. The memory is an example of computer-readable media.
[0172] Computer-readable media includes permanent and non-permanent, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD), or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to computing devices. According to the definition herein, computer-readable media does not include transitory media such as modulated data signals and carriers.
[0173] It should also be noted that the terms "comprising", "including" or any other variant thereof are intended to cover non-exclusive inclusion, so that processes, methods, articles or devices including a series of elements not only include those elements, but also include other elements not explicitly listed or inherent to such processes, methods, articles or devices. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or device including the element.
[0174] From the above description, it can be seen that the above-mentioned embodiments of the present application achieve the following technical effects:
[0175] 1) In the edge plate perforation defect detection of the present application, the method acquires the top view image and the side view image of the edge plate, detects whether each edge plate hole of the edge plate has burrs through the top view image, detects whether the height, slope and diameter of each edge plate hole of the edge plate are qualified through the side view image, and then determines whether each edge plate hole has defects, so as to determine whether the edge plate has defects, without manual inspection, solving the problem of easy missed detection in manual inspection of edge plate perforation defects in the prior art.
[0176] 2) In the edge plate perforation defect detection device of the present application, the device acquires the top view image and the side view image of the edge plate, detects whether each edge plate hole of the edge plate has burrs through the top view image, detects whether the height, slope and diameter of each edge plate hole of the edge plate are qualified through the side view image, and then determines whether each edge plate hole has defects, so as to determine whether the edge plate has defects, without manual inspection, solving the problem of easy missed detection in manual inspection of edge plate perforation defects in the prior art.
[0177] The above descriptions are only the preferred embodiments of the present application, and are not intended to limit the present application. The present application can have various modifications and changes for those skilled in the art. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A method for detecting perforation defects in edge plates, characterized in that, The side plate includes a plurality of side plate holes, and the method includes: Obtain a top view image and a side view image of the side plate, the side plate including the side plate of the evaporator and the side plate of the condenser. The top view image is an image taken along the perforation direction, and the side view image is an image taken along the side direction, the side direction being perpendicular to the perforation direction. Detect whether there are burrs in each of the side plate holes of the side plate according to the top view image; The height and diameter of each hole in the side plate are checked according to the side view image to see if they are qualified. The height is the height difference between the top and bottom of the protrusion formed by the perforation of the side plate hole. If any one of the following conditions is met—that the side plate hole has burrs, that the height of the side plate hole is unqualified, or that the diameter of the side plate hole is unqualified—then the side plate hole is determined to have a defect. If at least one of the side plate holes is defective, it is determined that the side plate is defective; The method further includes: extracting the endpoint combination contour map of each of the side plate holes based on the side view image, wherein the endpoint combination contour map is a contour map formed by sequentially connecting multiple endpoints of the side plate holes, and the endpoints include two top plate endpoints at the top of the side plate hole and two bottom endpoints at the bottom of the side plate hole in the side view image; calculating the distance between the first top plate endpoint and the bottom straight line in the endpoint combination contour map to obtain the first height of the side plate hole; calculating the distance between the second top plate endpoint and the bottom straight line in the endpoint combination contour map to obtain the second height of the side plate hole, wherein the bottom straight line is the line connecting the two bottom endpoints at the bottom of the side plate hole, and the two top plate endpoints include the first top plate endpoint; The first length is obtained by calculating the length of the first oblique line in the contour diagram of the endpoint combination, and the second length is obtained by calculating the length of the second oblique line in the contour diagram of the endpoint combination. The first oblique line is the contour line in the contour diagram of the endpoint combination with the first top plate endpoint and the bottom endpoint as endpoints, and the second oblique line is the contour line in the contour diagram of the endpoint combination with the second top plate endpoint and the bottom endpoint as endpoints. A first slope is calculated based on the first height and the first length, and a second slope is calculated based on the second height and the second length. It is determined that the side plate hole where the first slope and / or the second slope is not equal to the predetermined slope has a defect.
2. The method according to claim 1, characterized in that, Detecting whether burrs exist in each hole of the side plate based on the top view image includes: Extract the outlines of each of the side plate holes in the top view image to obtain multiple side plate hole outlines; Subtract the standard side plate hole contour from the multiple side plate hole contours to obtain multiple differential contours, wherein the standard side plate hole contour is the contour of the side plate hole without burrs. The side plate hole was found to have burrs, indicating that the differential contour contained scattered spots.
3. The method according to claim 1, characterized in that, Detecting whether the height and diameter of each hole in the side plate are qualified based on the side view image includes: The endpoint combination contour map of each side plate hole is extracted from the side view image. The endpoint combination contour map is a contour map formed by connecting multiple endpoints of the side plate hole in sequence. The endpoints include the two top plate endpoints of the top of the side plate hole and the two bottom endpoints of the bottom of the side plate hole in the side view image. Calculate the distance between one of the top plate endpoints and the bottom straight line in the contour diagram of each endpoint combination to obtain the first height of each side plate hole; calculate the distance between the other top plate endpoint and the bottom straight line in the contour diagram of each endpoint combination to obtain the second height of each side plate hole; the bottom straight line is the line connecting the two bottom endpoints of the bottom of the side plate hole. The height of the side plate hole is determined to be unqualified if the first height and / or the second height is not equal to the predetermined height.
4. The method according to claim 1, characterized in that, Detecting whether the height and diameter of each hole in the side plate are qualified based on the side view image includes: The endpoint combination contour map of each side plate hole is extracted from the side view image. The endpoint combination contour map is a contour map formed by connecting multiple endpoints of the side plate hole in sequence. The endpoints include the two top plate endpoints of the top of the side plate hole and the two bottom endpoints of the bottom of the side plate hole in the side view image. Calculate the distance between the two top plate endpoints in the contour diagram of each endpoint combination to obtain the diameter of each side plate hole; The diameter of the side plate hole is determined to be non-compliant if it is not equal to the predetermined diameter.
5. The method according to any one of claims 1 to 4, characterized in that, The method further includes: The endpoint combination contour map of each side plate hole is extracted from the side view image. The endpoint combination contour map is a contour map formed by connecting multiple endpoints of the side plate hole in sequence. The endpoints include the two top plate endpoints of the top of the side plate hole and the two bottom endpoints of the bottom of the side plate hole in the side view image. The minimum distance between two adjacent combined contour maps is calculated to obtain the distance between multiple perforations; If the distance between any of the perforations is not equal to the predetermined distance, it is determined that the side plate has a defect.
6. The method according to any one of claims 1 to 4, characterized in that, After determining that the edge plate has a defect, the method further includes: Record the number of the side plate hole corresponding to the defect.
7. A device for detecting perforation defects in edge plates, characterized in that, The side plate includes a plurality of side plate holes, and the device includes: The acquisition unit is used to acquire a top view image and a side view image of the side plate, the side plate including the side plate of the evaporator and the side plate of the condenser. The top view image is an image taken along the perforation direction, and the side view image is an image taken along the side direction, the side direction being perpendicular to the perforation direction. The first detection unit is used to detect whether there are burrs in each of the side plate holes of the side plate according to the top view image; The second detection unit is used to detect whether the height and diameter of each side plate hole of the side plate are qualified according to the side view image, wherein the height is the height difference between the top and bottom of the protrusion formed by the perforation of the side plate hole; The first determining unit is used to determine that the side plate hole has a defect if any one of the following conditions is met: the side plate hole has burrs, the height of the side plate hole is unqualified, or the diameter of the side plate hole is unqualified. The second determining unit is used to determine that the side plate has a defect if at least one of the side plate holes has a defect; The device further includes: a third detection unit, configured to extract the endpoint combination contour map of each of the side plate holes based on the side view image, wherein the endpoint combination contour map is a contour map formed by sequentially connecting multiple endpoints of the side plate holes, and the endpoints include two top plate endpoints at the top of the side plate holes and two bottom endpoints at the bottom of the side plate holes in the side view image; and a fourth detection unit, configured to calculate the distance between the first top plate endpoint and the bottom straight line in the endpoint combination contour map to obtain the first height of the side plate hole, and calculate the distance between the second top plate endpoint and the bottom straight line in the endpoint combination contour map to obtain the second height of the side plate hole, wherein the bottom straight line is the line connecting the two bottom endpoints at the bottom of the side plate hole, and the two top plate endpoints include the first top plate endpoint and the bottom straight line. The second top plate endpoint is described; the fifth detection unit is used to calculate the length of the first oblique line in the endpoint combination contour diagram to obtain a first length, and calculate the length of the second oblique line in the endpoint combination contour diagram to obtain a second length, wherein the first oblique line is a contour line in the endpoint combination contour diagram with the first top plate endpoint and the bottom endpoint as endpoints, and the second oblique line is a contour line in the endpoint combination contour diagram with the second top plate endpoint and the bottom endpoint as endpoints; the sixth detection unit is used to calculate a first slope based on the first height and the first length, and calculate a second slope based on the second height and the second length; the seventh detection unit is used to determine that the side plate hole with the first slope and / or the second slope not equal to a predetermined slope has a defect.
8. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1 to 6.
9. A defect detection system, characterized in that, include: A camera, one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including methods for performing any one of claims 1 to 6.
Citation Information
Patent Citations
Detection device for injector needle top burrs
CN103134812A