Product dispensing parameter detection method and device, electronic equipment and storage medium
Through point cloud image processing and gradient change point calculation, the problem of dispensing parameters detection of translucent flexible products is solved, the detection accuracy is improved and automatic detection is realized, and the demand for low product consistency requirements is met.
Patent Information
- Application Number
- CN202411235368.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-04
- Publication Date
- 2024-11-29
AI Technical Summary
The prior art cannot effectively detect dispensing parameters of translucent flexible products. The imaging effect of traditional line laser sensors is poor, and the consistency of flexible products is poor, and there is a lack of obvious characteristics for detection.
By obtaining the point cloud image of the product to be detected, dividing the undispensed area and the dispensed area along the contour cumulative direction, calculating the forward and reverse gradient change points, determining the right reference area of the undispensed area, and dividing the dispensed area There is no glue on the left, glue in the middle, and glue on the right, so as to detect the width, height and whether the glue is overflowing.
It improves the detection accuracy of translucent flexible products, realizes automatic detection, meets the demand for low product consistency, and solves the problem that traditional methods cannot detect.
Smart Images

Figure CN119048484A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of machine vision technology, and in particular to a method, device, electronic equipment and storage medium for detecting product dispensing parameters. Background Art
[0002] As electronic products develop towards a more sophisticated direction, dispensing is an important process in the production and preparation of electronic products. The quality of dispensing has an important impact on the process and quality of subsequent products. Flexible products have the characteristics of inconsistent product transparency and uneven products. Therefore, there are high requirements for the feature extraction and detection of flexible products.
[0003] Traditional line laser sensors have good imaging effects for rigid products and non-transparent objects, but poor imaging effects for flexible transparent products. In addition, flexible products have poor consistency and no obvious features for follow-up detection. Therefore, they are currently unable to meet the application requirements of dispensing parameter detection methods for translucent flexible products. Summary of the invention
[0004] The present invention provides a method, device, electronic equipment and storage medium for detecting glue dispensing parameters of a product, so as to solve the problem that currently it is impossible to detect glue dispensing parameters of a translucent flexible product.
[0005] According to one aspect of the present invention, a method for detecting product dispensing parameters is provided, and the method for detecting product dispensing parameters comprises:
[0006] Acquire a point cloud image of the product to be inspected, and determine, according to the point cloud image, a non-glue-dispensed area and a glue-dispensed area divided along a cumulative direction of a contour of the product to be inspected;
[0007] Based on the non-glue-dispensing area and the glue-dispensing area, a positive gradient change point and a reverse gradient change point calculated along a single contour direction of the product to be inspected are determined, and according to the positive gradient change point and the reverse gradient change point, a right reference area of the non-glue-dispensing area is determined, and the glue-dispensing area is divided into a left non-glue area, a middle glue area, and a right non-glue area;
[0008] The glue width of the product to be detected is determined according to the middle glue area, the glue height of the product to be detected is determined according to the left glue-free area and the middle glue area, and whether the product to be detected has glue overflow is determined according to the right reference area and the middle glue area.
[0009] Optionally, determining the positive gradient change point and the reverse gradient change point calculated along a single contour direction of the product to be inspected based on the non-glue-dispensing area and the glue-dispensing area includes:
[0010] The actual gradient between two adjacent points along a single contour direction of the product to be inspected is calculated based on the non-glue-dispensing area and the glue-dispensing area, and the positive gradient change point and the reverse gradient change point are determined based on the actual gradient.
[0011] Optionally, determining a positive gradient change point and a reverse gradient change point based on the actual gradient includes:
[0012] The first jump point where the actual gradient in the positive direction along the single contour direction is greater than the set gradient is taken as the positive gradient change point, and the first jump point where the actual gradient in the reverse direction along the single contour direction is greater than the set gradient is taken as the reverse gradient change point.
[0013] Optionally, determining the right reference area of the non-glue-dispensed area according to the positive gradient change point and the reverse gradient change point and dividing the glue-dispensed area into a left glue-free area, a middle glue-dispensed area and a right glue-free area includes:
[0014] Define the positive gradient change point as (x p ,y i , z p ) and the reverse gradient change point is (x q ,y i , z q ), the undispensed area is x along a single contour direction p With x n The area between is defined as the right reference area of the non-dispensing area; and,
[0015] The glue dispensing area is placed along the single contour direction x1 and x p The area between is defined as the glue-free area on the left side of the glue-dotting area, and the glue-dotting area is divided into two parts along the single contour direction x p With x q The area between is defined as the middle glue area of the glue spotting area, and the glue spotting area is defined as the middle glue area of the glue spotting area along the single contour direction x q With x n The area between is defined as the glue-free area on the right side of the glue dispensing area.
[0016] Optionally, the positive gradient change point is defined as (x p ,y i , z p ) and the reverse gradient change point is (x q ,y i , z q );
[0017] Determining the glue width of the product to be detected according to the middle glue area, determining the glue height of the product to be detected according to the left glue-free area and the middle glue area, and determining whether the product to be detected has glue overflow according to the right reference area and the middle glue area, including:
[0018] The span of the middle glue-containing area along a single contour direction is defined as the glue width of the product to be inspected; and
[0019] Determine the glue height of the product to be tested according to the distance from each point on the middle glue area to the left glue-free area; and
[0020] The right limit position of each contour determined according to the right reference area and the actual right glue dispensing position determined according to the middle glue area are obtained, and whether the product to be inspected has glue overflow is determined according to the right limit position and the actual right glue dispensing position.
[0021] Optionally, determining the glue height of the product to be inspected according to the distance from each point on the middle glue area to the left glue-free area includes:
[0022] The glue height reference fitting straight line is obtained according to the left glue-free area, and the distance from each point on the middle glue area to the glue height reference fitting straight line is calculated to determine the glue height of the product to be tested.
[0023] Optionally, determining whether the product to be inspected has glue overflow according to the right limit position and the actual right glue dispensing position includes:
[0024] If the difference between the right limit position and the actual right glue dispensing position is greater than 0, it is determined that the current contour of the product to be inspected corresponding to the actual right glue dispensing position has no glue overflow;
[0025] If the difference between the right limit position and the actual right glue dispensing position is less than or equal to 0, the current contour of the product to be detected corresponding to the actual right glue dispensing position is determined to be glue overflow.
[0026] According to another aspect of the present invention, a product dispensing parameter detection device is provided, and the product dispensing parameter detection device comprises:
[0027] An area division module, used for acquiring a point cloud image of the product to be inspected, and determining, according to the point cloud image, an un-glue-dispensed area and a glue-dispensed area divided along a cumulative direction of a contour of the product to be inspected;
[0028] An area definition module, used for determining the positive gradient change points and the reverse gradient change points calculated along the single contour direction of the product to be inspected based on the non-glue-dispensing area and the glue-dispensing area, and determining the right reference area of the non-glue-dispensing area according to the positive gradient change points and the reverse gradient change points, and dividing the glue-dispensing area into a left non-glue area, a middle glue area, and a right non-glue area;
[0029] The glue dispensing parameter detection module is used to determine the glue width of the product to be detected based on the middle glue area, determine the glue height of the product to be detected based on the left glue-free area and the middle glue area, and determine whether the product to be detected has glue overflow based on the right reference area and the middle glue area.
[0030] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:
[0031] at least one processor; and,
[0032] a memory communicatively connected to the at least one processor; wherein,
[0033] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the product dispensing parameter detection method described in any embodiment of the present invention.
[0034] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the product dispensing parameter detection method described in any embodiment of the present invention when executed.
[0035] The technical solution of the embodiment of the present invention divides the point cloud image of the product to be inspected into un-glueized areas and glued areas along the cumulative direction of the contour of the product to be inspected, and based on the gradient jump of the un-glueized areas and the glued areas, defines the right reference area of the un-glueized area and the left non-glue area, the middle glue area and the right non-glue area divided by the glued area, and then detects and determines the glue width, glue height and whether there is glue overflow of the product to be inspected, thereby solving the problem that the glue dispensing parameters of translucent flexible products cannot be detected at present, achieving the improvement of the detection accuracy of translucent flexible products, and realizing automatic detection requirements, while having low requirements on product consistency.
[0036] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0038] Figure 1 This is a flow chart of a method for detecting product dispensing parameters provided in accordance with the first embodiment of the present invention;
[0039] Figure 2 is a schematic diagram of an exemplary point cloud image of a product to be inspected provided according to Embodiment 1 of the present invention;
[0040] Figure 3 is a schematic diagram of region division of a point cloud image of an exemplary product to be inspected provided in Embodiment 1 of the present invention;
[0041] Figure 4 is a schematic diagram of a single contour of a non-glue-dispensing area in a point cloud image of an exemplary product to be inspected provided in Embodiment 1 of the present invention;
[0042] Figure 5 is a schematic diagram of a single outline of a glue-dispensing area in a point cloud image of an exemplary product to be inspected provided in accordance with the first embodiment of the present invention;
[0043] Figure 6 This is a flow chart of a method for detecting product dispensing parameters provided in accordance with Embodiment 2 of the present invention;
[0044] Figure 7 It is a structural schematic diagram of a product dispensing parameter detection device provided according to the third embodiment of the present invention;
[0045] Figure 8 It is a structural schematic diagram of an electronic device for implementing the product dispensing parameter detection method according to an embodiment of the present invention. DETAILED DESCRIPTION
[0046] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
[0047] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0048] Embodiment 1
[0049] Figure 1 A flowchart of a method for detecting glue dispensing parameters of a product is provided for the first embodiment of the present invention. This embodiment can be applied to the case of high-precision detection of glue dispensing parameters of semi-transparent flexible products based on gradient jump. The method for detecting glue dispensing parameters of a product can be executed by a device for detecting glue dispensing parameters of a product. The device for detecting glue dispensing parameters of a product can be implemented in the form of hardware and / or software. The device for detecting glue dispensing parameters of a product can be configured in an electronic device for detecting semi-transparent flexible products. Figure 1 As shown, the dispensing parameter detection method of the product includes:
[0050] S110, obtaining a point cloud image of the product to be inspected, and determining, according to the point cloud image, a non-glue-dispensed area and a glue-dispensed area divided along a cumulative direction of a contour of the product to be inspected.
[0051] The product to be inspected may be, but is not limited to, a flexible translucent product or a transparent product, and this embodiment does not impose any limitation on this.
[0052] Since the traditional line laser reconstruction effect of flexible translucent products or transparent products is poor and cannot meet the subsequent dispensing detection requirements, the point cloud image of the product to be inspected in this embodiment can be obtained by taking a camera using spectral confocal technology. This embodiment does not impose any restrictions on the specific camera type.
[0053] Furthermore, in order to ensure the consistency of the glue dispensing thickness and avoid the distortion of the reconstruction of the lower layer of multi-layer point cloud data, the point cloud image of the product to be inspected uses the camera with spectral confocal technology to take the upper layer data as the original point data, that is, the point cloud image of the product to be inspected is the point cloud image of the top layer. For details, see Figure 2 shown.
[0054] On the basis of the above, based on Figure 2 The point cloud image shown is Figure 3The area division shown in the figure is as follows: the positive direction of a single contour of the product to be inspected is defined as the X direction, the number of points of a single contour is n, the contour accumulation direction is the Y direction, and the total number of contours is m. The non-glue-dispensing area and glue-dispensing area are divided along the cumulative direction of the contour of the product to be inspected, that is, the y direction is the positive direction of the single contour of the product to be inspected, the number of points of a single contour is n, the contour accumulation direction is the Y direction, and the total number of contours is m. t The boundary value between the non-dispensing area and the dispensing area is used to divide the area. Figure 3 The first half of the cumulative direction of the contour of the product to be tested is the non-dispensing area, which can be recorded as R y前 , a single line outline of the undispensed area is as follows Figure 4 As shown in the figure, similarly, the latter half of the cumulative direction along the contour of the product to be inspected is the glue dispensing area, which can be recorded as R y后 , a single line outline of the dispensing area is as follows Figure 5 shown.
[0055] It can be understood that after obtaining the point cloud image of the product to be inspected, the coordinate data of each contour can be compared along the cumulative direction of the contour of the product to be inspected based on the point cloud image, so as to determine the boundary value between the un-glued area and the glued area, and then divide the un-glued area and the glued area in the point cloud image.
[0056] S120. Determine the positive gradient change point and the reverse gradient change point calculated along a single contour direction of the product to be inspected based on the non-glue-dispensed area and the glue-dispensed area, and determine the right reference area of the non-glue-dispensed area according to the positive gradient change point and the reverse gradient change point, and divide the glue-dispensed area into a left non-glue area, a middle glue area, and a right non-glue area.
[0057] On the basis of the above, each contour is extracted along the cumulative direction of the contour of the product to be detected, and the Y value of each contour is y1, y2, y3, ... y m , taking the i-th contour as an example, the X coordinate and Z coordinate data of each contour are recorded as {x1, x2, x3…x n} and {z1, z2, z3…z n},from Figure 4 and Figure 5 It can be seen from the single contour that there is an obvious gradient change at the edge of the glue point. The actual gradient between two adjacent points calculated along the single contour direction of the product to be tested can be recorded as G, where G = {g1, g2, g3…g n-1}, thus, the first jump point where the actual gradient in the positive direction along the single contour direction is greater than the set gradient is taken as the positive gradient change point, and the first jump point where the actual gradient in the reverse direction along the single contour direction is greater than the set gradient is taken as the reverse gradient change point.
[0058] It can be known that the actual gradient can be calculated using an existing gradient calculation formula or other means, and this embodiment does not impose any limitation on this.
[0059] Continue to see Figure 3 As shown, the positive gradient change point is defined as (x p ,y i , z p ) and the reverse gradient change point is (x q ,y i , z q ), taking the i-th contour as an example, for the undispensed area, each contour is x along the single contour direction. p With x n The area between is defined as the right reference area of the undispensed area, denoted as R y前x右 .
[0060] Similarly, taking the i-th contour as an example, for the dispensing area, each contour is connected along the single contour direction x1 and x p The area between is defined as the glue-free area on the left side of the glue-dispensing area, denoted as R y后x左 , and, for the dispensing area, each contour is x along a single contour direction p With x q The area between is defined as the glue area in the middle of the glue dispensing area, denoted as R y后x中 , and, for the dispensing area, each contour is x along a single contour direction q With x n The area between is defined as the glue-free area on the right side of the glue-dispensing area, denoted as R y后x右 .
[0061] S130, determining the glue width of the product to be inspected according to the middle glue area, determining the glue height of the product to be inspected according to the left glue-free area and the middle glue area, and determining whether the product to be inspected has glue overflow according to the right reference area and the middle glue area.
[0062] The glue width is the glue dot width of the product to be tested in a single contour direction, with glue area R in the middle. y后x中 is the actual glue dispensing area of the product to be tested, then according to the glue area R in the middle y后x中 The span along a single contour direction can be defined as the glue width of the product to be inspected. For the glue area R in the middle y后x中 For each contour, the glue width of the contour is the glue width of the product to be tested W = x q -x p .
[0063] Based on the above, the left glue-free area R y后x左As the reference area for calculating the glue height, the glue height reference fitting straight line is obtained based on the glue-free area on the left, and the glue height of the middle area R is further calculated. y后x中 The distance from each point on the graph to the glue height reference fitting straight line is taken, and the maximum distance is selected as the glue height of the product to be tested.
[0064] In this embodiment, for the right reference area R y后x右 The right limit position of each contour can be calculated through its gradient change. Further, according to the middle glue area R y后x中 The actual right side glue dispensing position is determined, and then whether the product to be inspected has glue overflow is determined according to the right side limit position and the actual right side glue dispensing position.
[0065] Specifically, if the difference between the right limit position and the actual right glue dispensing position is greater than 0, it is determined that the current contour of the product to be inspected corresponding to the actual right glue dispensing position has no glue overflow; if the difference between the right limit position and the actual right glue dispensing position is less than or equal to 0, it is determined that the current contour of the product to be inspected corresponding to the actual right glue dispensing position has glue overflow.
[0066] The technical solution of the embodiment of the present invention obtains a point cloud image of the product to be detected, and determines the un-glueed area and the glued area divided along the cumulative direction of the contour of the product to be detected based on the point cloud image; determines the positive gradient change points and the reverse gradient change points calculated along the single contour direction of the product to be detected based on the un-glueed area and the glued area, and determines the right reference area of the un-glueed area according to the positive gradient change points and the reverse gradient change points, and divides the glued area into a left glue-free area, a middle glued area, and a right glue-free area; determines the glue width of the product to be detected according to the middle glued area, determines the glue height of the product to be detected according to the left glue-free area and the middle glued area, and determines whether the product to be detected has overflowed glue according to the right reference area and the middle glued area. The present invention solves the problem that it is currently impossible to perform glue dispensing parameter detection on translucent flexible products, achieves the improvement of the detection accuracy of translucent flexible products, and can meet the needs of automatic detection, while having low requirements on product consistency.
[0067] Embodiment 2
[0068] Figure 6 This is a flow chart of a method for detecting product dispensing parameters provided in the second embodiment of the present invention. Based on the above embodiment, this embodiment performs dispensing parameter detection on a translucent flexible product based on gradient jump, providing an optional implementation method. Figure 6 As shown, the dispensing parameter detection method of the product includes:
[0069] S210, obtaining a point cloud image of the product to be inspected, and determining, according to the point cloud image, a non-glue-dispensed area and a glue-dispensed area divided along a cumulative direction of a contour of the product to be inspected.
[0070] S220, calculating the actual gradient between two adjacent points along a single contour direction of the product to be inspected based on the non-glue-dispensing area and the glue-dispensing area, and determining a positive gradient change point and a reverse gradient change point based on the actual gradient.
[0071] For example, the actual gradient G between two adjacent points is calculated along a single contour direction of the product to be inspected = {g1, g2, g3 ... g n-1}, the actual gradient G is compared with the set gradient change threshold G0, and then the first jump point p where the actual gradient in the positive direction of a single contour direction is greater than the set gradient change threshold G0 is taken as the positive gradient change point (x p ,y i , z p ), and the first jump point q where the actual gradient in the reverse direction of a single contour is greater than the set gradient change threshold G0 is taken as the reverse gradient change point (x q ,y i , z q ).
[0072] It can be understood that the absolute value of the actual gradient G is compared with the set gradient change threshold G0, respectively, so as to accurately determine the first jump point in the forward direction and the reverse direction that is greater than the set gradient change threshold G0.
[0073] The gradient change threshold G0 may be selected and set according to the actual dispensing parameter detection accuracy requirement, and this embodiment does not impose any limitation on this.
[0074] S230, determining a right reference area of the non-glue-dispensed area according to the positive gradient change point and the reverse gradient change point, and dividing the glue-dispensed area into a left glue-free area, a middle glue-dispensed area, and a right glue-free area.
[0075] S240, determining the glue width of the product to be inspected according to the middle glue area, determining the glue height of the product to be inspected according to the left glue-free area and the middle glue area, and determining whether the product to be inspected has glue overflow according to the right reference area and the middle glue area.
[0076] Based on the above, the left glue-free area R y后x左 As the reference area for calculating the glue height, denoising is first required, that is, median smoothing is used to remove the glue-free area R on the left. y后x左 The abnormal jumping points on the left side are further analyzed for the denoised glue-free area R y后x左 Perform straight line fitting to obtain the straight line equation of the glue height reference fitting line: Z=k1*X+b1, where k1 and b1 are constants, which are determined according to the actual glue dispensing situation of the product to be tested.
[0077] It is understandable that other denoising methods can also be used to remove the left glue-free area R y后x左 The denoising process is performed, and this embodiment does not impose any limitation on this.
[0078] Based on the above, calculate the middle dispensing area R y后x中 The distance D from each point to the glue height reference fitting straight line, where D = {d1, d2, d3…d q-p+1}, and its calculation formula is: Furthermore, the glue height of the product to be tested is selected as the maximum value d in D max , that is, the glue height of the product to be tested is H = d max .
[0079] It should be noted that after determining the glue width and glue height of the product to be inspected, the actual glue width and glue height of the product to be inspected at this time can be compared and judged according to the theoretical glue width threshold and glue height threshold to determine whether the product to be inspected is qualified for glue dispensing. This embodiment does not impose any restrictions on the specific theoretical glue width threshold and glue height threshold, which can be determined by technical personnel in this field according to the actual product glue dispensing parameter detection requirements.
[0080] In this embodiment, for the undispensed area R y前 Along the first half of the cumulative direction of the contour of the product to be inspected, the right gradient change point {(x 1_q ,y1,z 1_q ), (x 2_q ,y2,z 2_q )…(x t_q ,y t , z t_q )}, fit the X coordinate and Y coordinate of the gradient change point on the right side to obtain the equation of the glue dispensing limit line on the right side as X=k2*Y+b2, where k2 and b2 are constants, which can be determined according to the actual glue dispensing situation of the product to be tested. y前 Along the second half of the cumulative direction of the contour of the product to be inspected, the right limit position of each contour can be calculated by the right dispensing limit straight line equation, which can be recorded as {x t+1_限位 , x t+2_限位 …x m_限位}.
[0081] Based on the above, according to the middle glue area R y后x中 Determine the actual right side dispensing position, the actual right side dispensing position is {x t+1_q , x t+2_q …X m_q}, calculate the difference between the right limit position and the actual dispensing position on the right, △, i =x t+i_限位 -xt+i_q ,△={△ t+1 ,△ t+2 …△ m}, based on this, analyze the △ value of each contour and determine whether the difference △ is positive or negative. Specifically: if the difference between the right limit position and the actual right dispensing position is greater than 0, that is, △ i >0, it is determined that the current contour of the product to be tested corresponding to the actual right side dispensing position has no overflow glue. Conversely, if the difference between the right limit position and the actual right side dispensing position is less than or equal to 0, that is, △ i ≤0, it is determined that the current contour of the product to be detected corresponding to the actual right side dispensing position has overflowed glue, that is, the product to be detected has overflowed glue.
[0082] The technical solution of the embodiment of the present invention, through the point cloud image of the product to be inspected, divides the un-glueized area and the glued area along the cumulative direction of the contour of the product to be inspected, calculates the actual gradient between two adjacent points in the un-glueized area and the glued area along the single contour direction of the product to be inspected, and determines the positive gradient change point and the reverse gradient change point based on the actual gradient. It can quickly realize the detection of glue height, glue width and overflow of flexible translucent products or transparent products, has low requirements on the consistency of incoming materials of the product to be inspected, and has high accuracy in glue dispensing parameter detection, and can meet the demand for fully automatic detection of colloid parameters on flexible products.
[0083] Embodiment 3
[0084] Figure 7 This is a schematic diagram of the structure of a product dispensing parameter detection device provided in the third embodiment of the present invention. Figure 7 As shown, the product dispensing parameter detection device includes:
[0085] The area division module 310 is used to obtain a point cloud image of the product to be inspected, and determine the non-glue-dispensing area and the glue-dispensing area divided along the cumulative direction of the contour of the product to be inspected according to the point cloud image;
[0086] The area definition module 320 is used to determine the positive gradient change points and the reverse gradient change points calculated along the single contour direction of the product to be inspected based on the non-glue-dispensing area and the glue-dispensing area, and determine the right reference area of the non-glue-dispensing area according to the positive gradient change points and the reverse gradient change points, and divide the glue-dispensing area into a left non-glue area, a middle glue area, and a right non-glue area;
[0087] The glue dispensing parameter detection module 330 is used to determine the glue width of the product to be detected based on the middle glue area, determine the glue height of the product to be detected based on the left glue-free area and the middle glue area, and determine whether the product to be detected has glue overflow based on the right reference area and the middle glue area.
[0088] Optionally, based on the non-glue-dispensing area and the glue-dispensing area, the forward gradient change point and the reverse gradient change point calculated along the single contour direction of the product to be inspected are determined, which are specifically used for:
[0089] The actual gradient between two adjacent points along a single contour direction of the product to be inspected is calculated based on the non-glue-dispensing area and the glue-dispensing area, and the positive gradient change point and the reverse gradient change point are determined based on the actual gradient.
[0090] Optionally, a positive gradient change point and a reverse gradient change point are determined based on the actual gradient, specifically for:
[0091] The first jump point where the actual gradient in the positive direction along the single contour direction is greater than the set gradient is taken as the positive gradient change point, and the first jump point where the actual gradient in the reverse direction along the single contour direction is greater than the set gradient is taken as the reverse gradient change point.
[0092] Optionally, determining the right reference area of the non-glue-dispensing area and dividing the glue-dispensing area into a left glue-free area, a middle glue-dispensing area and a right glue-free area according to the positive gradient change point and the reverse gradient change point is specifically used for:
[0093] Define the positive gradient change point as (x p ,y i , z p ) and the reverse gradient change point is (x q ,y i , z q ), move the undispensed area along the single contour direction x p With x n The area between is defined as the right reference area of the undispensed area; and,
[0094] Set the dispensing area along the single contour direction x1 and x p The area between is defined as the glue-free area on the left side of the glue-dispensing area, and the glue-dispensing area is defined as the glue-free area on the left side of the glue-dispensing area along the single contour direction x p With x q The area between is defined as the glue area in the middle of the glue dispensing area, and the glue dispensing area is divided into two parts along the single contour direction x q With x n The area between is defined as the glue-free area on the right side of the glue dispensing area.
[0095] Optionally, define the positive gradient change point as (x p ,y i , z p ) and the reverse gradient change point is (x q ,y i , z q );
[0096] Determine the glue width of the product to be tested based on the glue area in the middle, determine the glue height of the product to be tested based on the glue-free area on the left and the glue area in the middle, and determine whether the product to be tested has glue overflow based on the reference area on the right and the glue area in the middle. Specifically used for:
[0097] The glue width of the product to be inspected is defined as the span of the glue-containing area in the middle along a single contour direction; and
[0098] Determine the glue height of the product to be tested based on the distance from each point on the middle glue area to the left glue-free area; and
[0099] The right limit position of each contour determined according to the right reference area and the actual right glue dispensing position determined according to the middle glue area are obtained, and whether the product to be inspected has glue overflow is determined according to the right limit position and the actual right glue dispensing position.
[0100] Optionally, the glue height of the product to be tested is determined according to the distance from each point on the middle glue area to the left glue-free area, which is specifically used for:
[0101] The glue height reference fitting straight line is obtained according to the glue-free area on the left, and the distance from each point on the glue-containing area in the middle to the glue height reference fitting straight line is calculated to determine the glue height of the product to be tested.
[0102] Optionally, whether the product to be inspected has glue overflow is determined based on the right limit position and the actual right glue dispensing position, which is specifically used for:
[0103] If the difference between the right limit position and the actual right dispensing position is greater than 0, it is determined that the current contour of the product to be inspected corresponding to the actual right dispensing position has no overflowing glue;
[0104] If the difference between the right limit position and the actual right dispensing position is less than or equal to 0, the current contour overflow of the product to be detected corresponding to the actual right dispensing position is determined.
[0105] The product dispensing parameter detection device provided in the embodiment of the present invention can execute the product dispensing parameter detection method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects for executing the product dispensing parameter detection method.
[0106] Embodiment 4
[0107] Figure 8A schematic diagram of an electronic device 410 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.
[0108] like Figure 8 As shown, the electronic device 410 includes at least one processor 411, and a memory connected to the at least one processor 411, such as a read-only memory (ROM 412), a random access memory (RAM 413), etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 411 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM 412) or the computer program loaded from the storage unit 418 to the random access memory (RAM 413). In RAM 413, various programs and data required for the operation of the electronic device 410 can also be stored. The processor 411, ROM 412 and RAM 413 are connected to each other via a bus 414. An I / O (input / output) interface 415 is also connected to the bus 414.
[0109] Multiple components in the electronic device 410 are connected to the I / O interface 415, including: an input unit 416, such as a keyboard, a mouse, etc.; an output unit 417, such as various types of displays, speakers, etc.; a storage unit 418, such as a disk, an optical disk, etc.; and a communication unit 419, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 419 allows the electronic device 410 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0110] The processor 411 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 411 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 411 executes the various methods and processes described above, such as a product dispensing parameter detection method.
[0111] In some embodiments, the product dispensing parameter detection method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 418. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 410 via the ROM 412 and / or the communication unit 419. When the computer program is loaded into the RAM 413 and executed by the processor 411, one or more steps of the product dispensing parameter detection method described above may be performed. Alternatively, in other embodiments, the processor 411 may be configured to execute the product dispensing parameter detection method in any other appropriate manner (e.g., by means of firmware).
[0112] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0113] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0114] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0115] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).
[0116] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.
[0117] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.
[0118] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.
[0119] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims
1. A method for detecting product dispensing parameters, characterized in that: include: Acquire a point cloud image of the product to be inspected, and determine, according to the point cloud image, a non-glue-dispensed area and a glue-dispensed area divided along a cumulative direction of a contour of the product to be inspected; Based on the non-glue-dispensing area and the glue-dispensing area, a positive gradient change point and a reverse gradient change point calculated along a single contour direction of the product to be inspected are determined, and according to the positive gradient change point and the reverse gradient change point, a right reference area of the non-glue-dispensing area is determined, and the glue-dispensing area is divided into a left non-glue area, a middle glue area, and a right non-glue area; The glue width of the product to be detected is determined according to the middle glue area, the glue height of the product to be detected is determined according to the left glue-free area and the middle glue area, and whether the product to be detected has glue overflow is determined according to the right reference area and the middle glue area.
2. The method for detecting product dispensing parameters according to claim 1, characterized in that: Determining the positive gradient change point and the reverse gradient change point calculated along a single contour direction of the product to be inspected based on the non-glue-dispensing area and the glue-dispensing area, including: The actual gradient between two adjacent points along a single contour direction of the product to be inspected is calculated based on the non-glue-dispensing area and the glue-dispensing area, and the positive gradient change point and the reverse gradient change point are determined based on the actual gradient.
3. The method according to claim 2, characterized in that Determining a positive gradient change point and a reverse gradient change point based on the actual gradient includes: The first jump point where the actual gradient in the positive direction along the single contour direction is greater than the set gradient is taken as the positive gradient change point, and the first jump point where the actual gradient in the reverse direction along the single contour direction is greater than the set gradient is taken as the reverse gradient change point.
4. The method for detecting product dispensing parameters according to claim 1, characterized in that: Determining the right reference area of the non-glue-dispensed area according to the positive gradient change point and the reverse gradient change point and dividing the glue-dispensed area into a left glue-free area, a middle glue-dispensed area and a right glue-free area, including: Define the positive gradient change point as (x p ,y i , z p ) and the reverse gradient change point is (x q ,y i , z q ), the undispensed area is x along a single contour direction p With x n The area between is defined as the right reference area of the non-dispensing area; and, The glue dispensing area is placed along the single contour direction x1 and x p The area between is defined as the glue-free area on the left side of the glue-dotting area, and the glue-dotting area is divided into two parts along the single contour direction x p With x q The area between is defined as the middle glue area of the glue spotting area, and the glue spotting area is defined as the middle glue area of the glue spotting area along the single contour direction x q With x n The area between is defined as the glue-free area on the right side of the glue dispensing area.
5. The method for detecting product dispensing parameters according to claim 1, characterized in that: Determining the glue width of the product to be detected according to the middle glue area, determining the glue height of the product to be detected according to the left glue-free area and the middle glue area, and determining whether the product to be detected has glue overflow according to the right reference area and the middle glue area, including: The span of the middle glue-containing area along a single contour direction is defined as the glue width of the product to be inspected; and Determine the glue height of the product to be tested according to the distance from each point on the middle glue area to the left glue-free area; and The right limit position of each contour determined according to the right reference area and the actual right glue dispensing position determined according to the middle glue area are obtained, and whether the product to be inspected has glue overflow is determined according to the right limit position and the actual right glue dispensing position.
6. The method for detecting product dispensing parameters according to claim 5, characterized in that: Determining the glue height of the product to be detected according to the distance from each point on the middle glue area to the left glue-free area includes: The glue height reference fitting straight line is obtained according to the left glue-free area, and the distance from each point on the middle glue area to the glue height reference fitting straight line is calculated to determine the glue height of the product to be tested.
7. The method for detecting product dispensing parameters according to claim 5, characterized in that: Determining whether the product to be inspected has glue overflow according to the right limit position and the actual right glue dispensing position includes: If the difference between the right limit position and the actual right glue dispensing position is greater than 0, it is determined that the current contour of the product to be inspected corresponding to the actual right glue dispensing position has no glue overflow; If the difference between the right limit position and the actual right glue dispensing position is less than or equal to 0, the current contour of the product to be detected corresponding to the actual right glue dispensing position is determined to be glue overflow.
8. A product dispensing parameter detection device, characterized in that: include: An area division module, used for acquiring a point cloud image of the product to be inspected, and determining, according to the point cloud image, an un-glue-dispensed area and a glue-dispensed area divided along a cumulative direction of a contour of the product to be inspected; An area definition module, used for determining the positive gradient change points and the reverse gradient change points calculated along the single contour direction of the product to be inspected based on the non-glue-dispensing area and the glue-dispensing area, and determining the right reference area of the non-glue-dispensing area according to the positive gradient change points and the reverse gradient change points, and dividing the glue-dispensing area into a left non-glue area, a middle glue area, and a right non-glue area; The glue dispensing parameter detection module is used to determine the glue width of the product to be detected based on the middle glue area, determine the glue height of the product to be detected based on the left glue-free area and the middle glue area, and determine whether the product to be detected has glue overflow based on the right reference area and the middle glue area.
9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the product dispensing parameter detection method described in any one of claims 1-7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the product dispensing parameter detection method described in any one of claims 1-7 when executed.
Citation Information
Cited By
PCBA whole board dispensing colloid detection method and system based on multi-mode fusion
CN121639609A
