Glue road detection method, electronic device and storage medium
The method and device enhance glue path detection accuracy by segmenting and calculating geometric features using 3D sensors, addressing inaccuracies in current detection methods and improving product quality and waterproofing.
Patent Information
- Application Number
- CN202110893191.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-08-04
- Publication Date
- 2024-12-27
- Estimated Expiration
- 2041-08-04
AI Technical Summary
Current glue path detection methods lack comprehensive information acquisition, leading to inaccurate detection results and potential issues such as glue breakage, insufficient glue, or glue collapse, which affect the waterproof effect and appearance of electronic products.
A method and device for detecting glue paths that involve acquiring an image, segmenting it based on geometric features, and calculating glue height, width, and position information to improve detection accuracy, using 3D sensors for richer data and adaptive threshold segmentation to determine the region of interest.
Enhances the comprehensiveness and accuracy of glue path detection by obtaining detailed shape information, reducing the likelihood of glue-related defects and improving the quality and waterproof performance of electronic products.
Smart Images

Figure CN113781392B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of image processing technology, and in particular, relates to a method for detecting a glue path, a device for detecting a glue path, an electronic device, and a computer-readable storage medium. Background Art
[0002] Glue dispensing is an important pre-step for screen mounting, and its main purpose is to firmly adhere the screen and the middle frame. Poor glue dispensing can lead to many problems, such as glue breakage, insufficient glue, or glue collapse (internal bonding), which may cause the screen and the middle frame to be loosely bonded, which in turn greatly reduces the waterproof effect or appearance of the product, requiring secondary rework. In order to prevent secondary rework, it is necessary to test the glue path.
[0003] However, the current glue road detection method has limited detection of glue road information and cannot obtain comprehensive glue road information, resulting in inaccurate detection results. Summary of the invention
[0004] The present application provides a glue path detection method, a glue path detection device, an electronic device and a computer-readable storage medium, which can obtain comprehensive glue path information and improve the accuracy of glue path detection results.
[0005] In a first aspect, the present application provides a method for detecting a glue path, comprising:
[0006] Acquire an image to be tested, wherein the image to be tested is an image obtained by photographing the rubber road to be tested;
[0007] Based on the geometric features of the rubber path to be tested, the image to be tested is divided into at least two images to be calculated;
[0008] Calculate the glue height, glue width and position information of the glue path to be measured according to each of the images to be calculated;
[0009] The glue path detection result is obtained based on the glue height, the glue width and the position information.
[0010] In a second aspect, the present application provides a device for detecting a glue path, comprising:
[0011] A first acquisition module is used to acquire an image to be tested, where the image to be tested is an image obtained by photographing the rubber road to be tested;
[0012] A segmentation module, used for segmenting the image to be tested into at least two images to be calculated based on the geometric features of the rubber path to be tested;
[0013] A calculation module, used for calculating the glue height, glue width and position information of the glue path to be measured according to each of the images to be calculated;
[0014] The detection module is used to obtain a glue path detection result based on the glue height, the glue width and the glue path position.
[0015] In a third aspect, the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method of the first aspect when executing the computer program.
[0016] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method of the first aspect are implemented.
[0017] In a fifth aspect, the present application provides a computer program product, which includes a computer program. When the computer program is executed by one or more processors, it implements the steps of the method of the first aspect.
[0018] Compared with the prior art, the present application has the following beneficial effects: the present application first obtains an image taken of the rubber road to be tested, i.e., the image to be tested, and then segments the image to be tested based on the geometric features of the rubber road to be tested to obtain the image to be calculated, and then calculates the rubber height, rubber width, and position information of the rubber road to be tested based on each image to be calculated, and finally obtains the rubber road detection result based on the calculated rubber height, rubber width, and position information of the rubber road to be tested. This method improves the comprehensiveness of the rubber road information detection by detecting information related to the shape of the rubber road, thereby improving the accuracy of the rubber road detection result. Among them, segmenting the image to be tested based on the geometric features of the rubber road to be tested can further improve the calculation accuracy of the rubber height, rubber width, and position information of the rubber road to be tested. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0020] Figure 1 It is a schematic diagram of the process of the method for detecting the glue path provided in the embodiment of the present application;
[0021] Figure 2 is a schematic diagram of a first / second cross-section without glue dispensing provided in an embodiment of the present application;
[0022] Figure 3 is a schematic diagram of a first / second cross-section of a qualified dispensing provided in an embodiment of the present application;
[0023] Figure 4 is a schematic diagram of a first / second cross section of a possible glue collapse phenomenon provided by an embodiment of the present application;
[0024] Figure 5 is a schematic diagram of a first / second cross section of a possible glue breaking phenomenon provided in an embodiment of the present application;
[0025] Figure 6 is a schematic diagram of a first / second cross section in which a wall climbing phenomenon may occur provided by an embodiment of the present application;
[0026] Figure 7 It is a schematic diagram of the structure of a detection device for a glue path provided in an embodiment of the present application;
[0027] Figure 8 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0028] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0029] The glue path detection method provided in the embodiment of the present application can be applied to electronic devices such as mobile phones, tablet computers, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), etc. The embodiment of the present application does not impose any restrictions on the specific types of electronic devices.
[0030] In order to illustrate the technical solution proposed in this application, a specific embodiment is provided below for illustration.
[0031] Figure 1 A schematic flow chart of the glue path detection method provided in the present application is shown. As an example but not a limitation, the method can be applied to any of the above-mentioned electronic devices.
[0032] Step 101: Acquire an image to be tested.
[0033] To inspect the rubber road, you can first obtain the image to be tested, where the image to be tested refers to the image taken of the rubber road to be tested.
[0034] Step 102: Segment the image to be tested into at least two images to be calculated based on the geometric features of the rubber path to be tested.
[0035] After obtaining the image to be tested, in order to improve the calculation accuracy of the relevant information of the glue path, the image to be tested can be segmented according to the geometric features of the glue path to be tested to obtain the image to be calculated. Different calculation processing methods can be adopted for different types of geometric features according to their characteristics, thereby improving the calculation accuracy of the relevant information of the glue path.
[0036] Step 103, calculating the glue height, glue width and position information of the glue path to be measured according to each image to be calculated.
[0037] After obtaining the images to be calculated, each image to be calculated can be processed to calculate the glue height, glue width and position information of the glue path. The reason why it is necessary to calculate the glue height, glue width and position information of the glue path to be tested is that if the height of the glue path is too low, it may cause glue collapse and / or glue breakage; if the height of the glue path is too high, it may cause glue overflow, affecting the appearance of the product; if the width of the glue path is narrow, glue collapse and / or glue breakage may occur; if the width of the glue path is wide, it may cause glue overflow, affecting the appearance of the product; if the position of the glue path is offset, glue collapse, glue breakage or glue overflow may occur. Therefore, by calculating the glue height, glue width and position information of the glue path, it is possible to judge whether the current glue path is qualified from various dimensions to improve the accuracy of the glue path detection results.
[0038] Step 104 : Obtain glue path detection results based on glue height, glue width and position.
[0039] After obtaining the glue height, glue width and position information of the glue road to be tested, the glue road test result can be determined based on these data. The glue road test results include qualified glue road and unqualified glue road. For unqualified glue roads, prompt information can be sent to facilitate further processing by workers to improve the qualified rate of glue roads. Among them, prompt information includes but is not limited to text prompts, voice prompts and / or whistles.
[0040] The embodiment of the present application first obtains an image of the rubber road to be tested, i.e., the image to be tested, and then segments the image to be tested based on the geometric features of the rubber road to be tested to obtain the image to be calculated, and then calculates the rubber height, rubber width, and position information of the rubber road to be tested according to each image to be calculated, and finally obtains the rubber road detection result according to the calculated rubber height, rubber width, and position information of the rubber road to be tested. This method improves the comprehensiveness of the rubber road information detection by detecting information related to the shape of the rubber road, thereby improving the accuracy of the rubber road detection result. Among them, segmenting the image to be tested according to the geometric features of the rubber road to be tested can further improve the calculation accuracy of the rubber height, rubber width, and position information of the rubber road to be tested.
[0041] In some embodiments, in order to improve the comprehensiveness of obtaining relevant information of the glue path, before the above step 101, the following may be included:
[0042] A1. Obtain the image data pointer of the rubber path to be tested through the 3D sensor.
[0043] With the rapid development of electronic products, people have higher and higher requirements on the appearance and performance of electronic products. The quality of screen mounting has a serious impact on the appearance and waterproof performance of electronic products. As an important step before screen mounting, whether the amount of glue is appropriate determines the quality of subsequent screen mounting to a large extent. Therefore, the glue path should be fully tested.
[0044] The embodiment of the present application uses a 3D sensor to collect image data of the glue path to be tested to provide richer data, thereby improving the accuracy of the glue path detection result. Compared with the prior art that uses a 2D sensor to collect image data of the glue path to be tested, the 3D sensor does not require a light source and will not be affected by the color of the product, and has a wider range of applications. In addition, for the same type of product, the 3D sensor only needs to set a set of parameters, which is more convenient to operate.
[0045] Optionally, the 3D sensor may be a 3D laser camera, through which the image data pointer of the rubber path to be tested can be obtained.
[0046] Accordingly, obtaining the image to be tested includes:
[0047] A2. Convert the image data pointer to obtain the image to be tested.
[0048] After the image data pointer is obtained, the image data pointer can be converted into a processable image, such as a depth image in an Image format. The image obtained at this time is the image to be tested.
[0049] In some embodiments, in order to facilitate image processing, the parameters of the image processor can be loaded, and the parameters that will be used for subsequent image processing can be converted into a two-dimensional matrix and stored. The storage format is the same as the format of the image to be tested, that is, the number of rows is the same as the number of rows of the image to be tested, so that an interface border uses a set of parameters to facilitate parameter management and calling, thereby improving the efficiency of image processing.
[0050] In some embodiments, after obtaining the image to be tested, the image to be tested may be preprocessed, for example, by using bilateral filtering to smooth the image, remove noise points and fill in invalid data in the image to be tested, thereby improving the efficiency of subsequent image processing.
[0051] In some embodiments, in order to improve the image processing efficiency and improve the calculation accuracy of the relevant information of the tested glue path, the above step 102 specifically includes:
[0052] B1. Determine the region of interest from the image to be tested.
[0053] The acquired image to be tested may contain other information that may interfere with subsequent calculations. In order to improve the efficiency and accuracy of subsequent calculations, the region of interest (ROI) can be determined from the image to be tested. In the field of image processing, the region of interest is an image area selected from the image. This area is the focus of attention when calculating the image to be tested. Further processing of the image to be processed based on the determined region of interest can reduce processing time and increase the accuracy of the calculation results.
[0054] B2. Segment the image to be tested into at least two images to be calculated based on the geometric features of the region of interest and the rubber path to be tested.
[0055] After determining the region of interest, the image to be tested can be segmented in combination with the geometric features of the test rubber path to obtain at least two images to be calculated. Different geometric features have different data characteristics. Therefore, by segmenting the image to be tested based on the region of interest and the geometric features of the test rubber path, more targeted operations can be taken in the subsequent processing of the image to be calculated, thereby improving the accuracy of the calculation results.
[0056] In some embodiments, in order to improve the accuracy of determining the region of interest, the above step B1 may include:
[0057] The region of interest is determined from the image to be tested through the method of adaptive threshold segmentation and extraction.
[0058] The method of adaptive threshold segmentation and extraction is used to extract the area with the largest area from the image to be tested, from which the region of interest is obtained to prepare for the subsequent segmentation of the image to be tested.
[0059] In some embodiments, in addition to the above-mentioned method of adaptive threshold segmentation and extraction to determine the region of interest, the region of interest can also be determined by the following steps:
[0060] B11. A template image is pre-set, and a region of interest is set on the template image.
[0061] B12. Match the template image with the image to be tested, and determine the region of interest from the image to be tested according to the matching result.
[0062] When acquiring image data of the glue path to be tested, the position of the 3D sensor is fixed, and the product carrying the glue path is also placed in a fixed position. Therefore, for the same type of products, the region of interest is also fixed. In view of this, the region of interest can be set on the template image by pre-setting a template image; and after obtaining the image to be tested, the template image is overlaid on the image to be tested for matching, and then the region of interest is determined from the image to be tested based on the matching results. This method can quickly complete the determination of the region of interest for the same type of product through one setting, which can improve the efficiency of determining the region of interest.
[0063] In some embodiments, in order to improve the accuracy of calculating the relevant information of the tested glue path, the above step B2 specifically includes:
[0064] B21. Crop the image to be tested based on the region of interest to obtain an image of the region of interest.
[0065] B22. Segment the image of the region of interest based on the geometric features of the rubber path to be measured to obtain the image to be calculated.
[0066] After determining the region of interest, the image to be tested can be cropped to obtain the image of the region of interest, and then the image of the region of interest can be segmented according to the geometric features of the glue path to be tested to obtain the image to be calculated. For mobile phones and similar electronic products, their glue paths have straight edges and R angles. Therefore, each image to be calculated can include the R angle of the glue path to be tested or the straight edge of the glue path to be tested.
[0067] In some embodiments, in order to improve the accuracy of calculating the information related to the tested glue path, the above step 103 specifically includes:
[0068] For each image to be calculated:
[0069] C11. If the image to be calculated contains the R angle of the glue path to be measured, then the border line of the glue path to be measured in the image to be calculated is obtained.
[0070] C12. Cutting a cross section of the border line in a direction perpendicular to the border line according to a first set step length to obtain at least one first cross-sectional image.
[0071] C13. Calculate the glue height, glue width and position information of the glue path to be tested according to each first cross-sectional image.
[0072] For an image to be calculated that includes the R angle of the glue path to be measured, the border of the glue path to be measured in the image to be calculated can be extracted. Optionally, the border can be extracted by an adaptive threshold segmentation method. As an example only, the path points of the border can be extracted by a skeleton refinement method. Then, the extracted path points of the border are fitted to obtain a border line. Afterwards, in a direction perpendicular to the border line, the cross section of the border line is intercepted according to a first set step size, wherein the direction perpendicular to the border line refers to the direction in which the R angle of the glue path to be measured points to the center of the circle.
[0073] After interception, the first cross-sectional image can be obtained, and the vertex of the frame can be found from the first cross-sectional image. Since the dispensing platform will be covered with glue and is not suitable as a measurement reference, the vertex of the frame is used as the reference for glue path detection. By reading the height difference between the platform and the vertex of the frame, the height of the platform is calculated, and the highest point of the glue path is searched inward from the vertex of the frame, and then the lowest point between the vertex of the frame and the highest point of the glue path is calculated. Among them, the glue height I1 = glue path vertex height - platform height, glue path position I2 = glue vertex position - vertex position of the frame, and the overflow glue groove height I3 = vertex of the frame - the minimum height value between the vertex of the glue path and the vertex of the frame. It should be understood that every time a first cross-sectional image is intercepted, a set of relevant data of the glue path to be tested can be obtained. When there are multiple first cross-sectional images, multiple sets of relevant data of the glue path to be tested can be obtained.
[0074] In some embodiments, in order to improve the accuracy of calculating the information related to the tested glue path, the above step 103 specifically includes:
[0075] For each image to be calculated:
[0076] C21. If the image to be calculated contains a straight edge of the rubber path to be measured, a cross section of the straight edge is intercepted according to a second set step length to obtain at least one second cross-sectional image.
[0077] C22. Calculate the glue height, glue width and glue line position information of the glue path to be measured according to each second cross-sectional image.
[0078] For the image to be calculated that contains the straight edge of the glue path to be measured, the cross-sectional area of the glue path to be measured in the image to be calculated can be directly intercepted according to the second step length, that is, the second cross-sectional image. After obtaining the second cross-sectional image, the frame vertex can be searched in the second cross-sectional image. Since the dispensing platform will be covered with glue and is not suitable as a measurement reference, the frame vertex is used as the reference for glue path detection. By reading the height difference between the platform and the frame vertex, the height of the platform is calculated, and the highest point of the glue path is searched inward from the frame vertex to find the highest point of the glue path, and then the lowest point between the frame vertex and the highest point of the glue path is calculated. Among them, the glue height I1 = glue path vertex height-platform height, the glue path position I2 = glue vertex position-frame vertex position, and the overflow glue groove height I3 = frame vertex-minimum height value between the glue path vertex and the frame vertex. It should be understood that each time a second cross-sectional image is intercepted, a set of relevant data of the glue path to be measured can be obtained. When there are multiple second cross-sectional images, multiple sets of relevant data of the glue path to be measured can be obtained.
[0079] For images to be calculated that contain different geometric features, different processing methods are used to calculate the relevant data of the rubber path to be measured in the images to be calculated, which can improve the accuracy of the calculation results.
[0080] In some embodiments, in order to improve the accuracy of the glue path detection result, the above step 104 may specifically include:
[0081] After obtaining the glue height, glue width and glue line position information of the glue road to be tested, each data can be compared with the set threshold to determine whether the relevant data of the glue road to be tested corresponding to a single first / second cross-sectional image meets the requirements. If the relevant data of the glue road to be tested corresponding to a specified number of consecutive first / second cross-sectional images do not meet the requirements, the current glue road can be judged as unqualified and the corresponding glue road detection result can be output.
[0082] For ease of understanding, an example is given: assuming that 10 first cross-sectional images are intercepted, 10 sets of relevant data of the glue path to be tested can be obtained accordingly. Assuming that 5 sets of relevant data of the glue path to be tested do not meet the requirements, and the glue path detection standard is that the relevant data of the glue path to be tested corresponding to 4 or more consecutive first / second cross-sectional images do not meet the requirements, the glue path to be tested is determined to be unqualified. At present, 5 sets of relevant data of the glue path to be tested do not meet the requirements, which means that the glue path to be tested is unqualified, and the unqualified part is the R angle of the glue path to be tested, which needs to be processed. However, if 10 first cross-sectional images and 10 second cross-sectional images are intercepted, and the relevant data of the glue path to be tested corresponding to 2 consecutive first cross-sectional images do not meet the requirements, and the relevant data of the glue path to be tested corresponding to 3 consecutive first cross-sectional images do not meet the requirements, although there are 5 images in total, these 5 images are not continuous cross-sectional images of the same type, so it can be determined that the current glue path to be tested is qualified and the subsequent mounting process can be carried out.
[0083] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0084] For ease of understanding, the glue road detection method proposed in this application is explained below using an actual application scenario.
[0085] like Figure 2 As shown in the figure, it is a schematic diagram of the first / second cross section without glue dispensing. Based on the schematic diagram of the first / second cross section without glue dispensing, the height difference between the frame vertex and the glue dispensing platform can be obtained, which can be used in the subsequent glue path detection process to calculate the glue path height. Figure 3 As shown, Figure 3 The first / second cross-sectional diagram of a qualified dispensing is shown in FIG. 1 , where the height difference between the frame vertex and the dispensing station is based on Figure 2 obtained, not directly in Figure 3 The measurement is obtained (similarly, the same applies to Figure 4-Figure 6 ).like Figure 4 As shown, Figure 4 The first and second cross-sectional diagrams show possible glue collapse. Figure 3 and Figure 4 , it can be seen that Figure 4 If the distance between the top of the glue path and the top of the frame is too wide, glue collapse is very likely to occur during the subsequent mounting process, affecting the quality of electronic products. Figure 5 As shown, Figure 5 The first and second cross-sectional diagrams show possible glue breaking phenomenon. Figure 3 and Figure 5 , obviously, Figure 5 Not only is the distance between the vertex of the glue path and the vertex of the frame too wide, but the height of the glue path itself is also too low. In the subsequent mounting process, glue breakage is very likely to occur, which may lead to rework of electronic products. Figure 6 As shown, Figure 6 Schematic diagram of the first / second cross section showing possible wall climbing phenomenon, compared Figure 3 and Figure 6 , obviously, Figure 6 The distance between the vertex of the glue path and the vertex of the frame for quality inspection is too narrow, and the height of the overflow glue groove is too low. In the subsequent mounting process, wall climbing is very likely to occur, resulting in a large amount of overflow glue, affecting the aesthetics of the electronic product.
[0086] During the inspection, if a cross-sectional image appears Figures 4 to 6 If there is a phenomenon, it can be judged that the relevant data of the adhesive path to be tested corresponding to the cross-sectional image does not meet the requirements. For the same type of cross-sectional images, if a specified number of cross-sectional images appear continuously and the relevant data of the adhesive path to be tested corresponding to the cross-sectional image does not meet the requirements, it can be judged that the test result of this type of adhesive path is unqualified, and a prompt should be issued to remind the operator to further process the unqualified adhesive path to improve the waterproof performance and aesthetics of the electronic product.
[0087] Corresponding to the detection method of the glue path described in the above embodiment, Figure 7 A structural block diagram of a glue path detection device 7 provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.
[0088] Reference Figure 7 , the detection device 7 of the glue path includes:
[0089] The first acquisition module 71 is used to acquire the image to be tested, where the image to be tested is an image obtained by photographing the rubber road to be tested;
[0090] A segmentation module 72, used for segmenting the image to be tested into at least two images to be calculated based on the geometric features of the rubber path to be tested;
[0091] A calculation module 73, used for calculating the glue height, glue width and position information of the glue path to be measured according to each of the images to be calculated;
[0092] The detection module 74 is used to obtain a glue path detection result based on the glue height, the glue width and the glue path position.
[0093] Optionally, the detection device 7 of the glue path may include:
[0094] The second acquisition module is used to acquire the image data pointer of the rubber road to be tested through the 3D sensor;
[0095] Correspondingly, the first acquisition module is specifically used to convert the image data pointer to obtain the image to be tested, and the image to be tested is a depth image of a specified type.
[0096] Optionally, the segmentation module 72 may include:
[0097] A determination unit, used for determining a region of interest from the image to be tested in the adhesive path to be tested;
[0098] The segmentation unit is used to segment the image to be tested into at least two images to be calculated based on the geometric features of the region of interest and the rubber path to be tested.
[0099] Optionally, the above-mentioned determination unit may be specifically configured to determine the region of interest from the image to be tested by using an adaptive threshold segmentation and extraction method.
[0100] Optionally, the determination unit may specifically pre-set a template image, on which the region of interest is set; match the template image with the image to be tested, and determine the region of interest from the image to be tested according to the matching result.
[0101] Optionally, the segmentation unit may include:
[0102] A cropping subunit, used for cropping the image to be measured based on the region of interest to obtain an image of the region of interest;
[0103] The segmentation subunit is used to segment the image of the region of interest based on the geometric features of the glue path to be measured to obtain images to be calculated, each of which contains the R angle of the glue path to be measured or the straight edge of the glue path to be measured.
[0104] Optionally, the calculation module 73 may include:
[0105] The first calculation unit is used for each image to be calculated: if the image to be calculated contains the R angle of the glue path to be measured, then the border line of the carrier in the calculation image is obtained, and the above-mentioned carrier is the product carrying the above-mentioned glue path to be measured; in the direction perpendicular to the above-mentioned border line, the cross-section of the above-mentioned border line is intercepted according to the first set step length to obtain at least one first cross-sectional image; according to each first cross-sectional image, the glue height, glue width and position information of the glue path to be measured are calculated.
[0106] Optionally, the calculation module 73 may include:
[0107] The second calculation unit is used for each image to be calculated: if the image to be calculated contains a straight edge of the glue path to be measured, then the cross-section of the straight edge is intercepted according to the second set step length to obtain at least one second cross-sectional image; and the glue height, glue width and glue line position information of the glue path to be measured are calculated according to each second cross-sectional image.
[0108] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.
[0109] Figure 8 This is a schematic diagram of the structure of an electronic device provided by an embodiment of the present application. Figure 8 As shown, the electronic device 8 of this embodiment includes: at least one processor 80 ( Figure 8 Only one is shown in the figure) a processor, a memory 81, and a computer program 82 stored in the memory 81 and executable on at least one processor 80. When the processor 80 executes the computer program 82, the steps in the above-mentioned method for detecting any glue path are implemented, for example Figure 1 Steps 101-104 are shown.
[0110] The processor 80 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0111] In some embodiments, the memory 81 may be an internal storage unit of the electronic device 8, such as a hard disk or memory of the electronic device 8. In other embodiments, the memory 81 may also be an external storage device of the electronic device 8, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device 8. Further, the memory 81 may also include both an internal storage unit of the terminal device 8 and an external storage device. The memory 81 is used to store operating devices, applications, boot loaders (BootLoader), data and other programs, such as program codes of computer programs, etc. The memory 81 may also be used to temporarily store data that has been output or is to be output.
[0112] The technicians in the field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0113] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.
[0114] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.
[0115] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of the above-mentioned various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the camera / electronic device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.
[0116] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0117] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0118] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0119] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0120] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A method for detecting a glue path, characterized in that: The detection method comprises: Acquire an image to be tested, wherein the image to be tested is an image obtained by photographing the rubber road to be tested; Segmenting the image to be tested into at least two images to be calculated based on the geometric features of the rubber path to be tested; Calculate the glue height, glue width and position information of the glue path to be measured according to each of the images to be calculated; Obtaining a glue path detection result based on the glue height, the glue width and the position information; Before acquiring the image to be tested, the method further includes: Acquire the image data pointer of the glue path to be tested by means of a 3D sensor; Accordingly, the step of acquiring the image to be tested includes: Converting the image data pointer to obtain the image to be tested, where the image to be tested is a depth image of a specified type; Each of the images to be calculated contains the R angle of the glue path to be measured or the straight edge of the glue path to be measured; and the glue height, glue width and glue path position information of the glue path to be measured are calculated according to each of the images to be calculated, including: For each image to be calculated: If the image to be calculated contains the R angle of the adhesive path to be measured, then the frame line of the carrier in the image to be calculated is obtained, and the carrier is the product carrying the adhesive path to be measured; Cutting a cross section of the border line in a direction perpendicular to the border line according to a first set step length to obtain at least one first cross-sectional image; If the image to be calculated contains the straight edge of the rubber path to be measured, then a cross section of the straight edge is intercepted according to a second set step length to obtain at least one second cross-sectional image; For each of the first cross-sectional image / the second cross-sectional image: determining a height difference between a platform of the carrier and a border vertex of a border from the first cross-sectional image / the second cross-sectional image to calculate a platform height of the platform; Searching from the vertex of the frame in the direction of the glue path to be tested to find the highest point of the glue path to be tested; Calculate the minimum height between the border vertex and the highest point; The difference between the vertex of the frame and the minimum height value is the height of the overflow groove of the glue path to be tested; The glue height is the height difference between the glue path vertex height and the platform height; The position information is determined based on the position of the glue path vertices and the position of the frame vertices.
2. The detection method according to claim 1, characterized in that The step of dividing the image to be tested into at least two images to be calculated based on the geometric features of the rubber path to be tested includes: Determine a region of interest from the image to be tested; The image to be tested is segmented into at least two images to be calculated based on the geometric features of the region of interest and the rubber path to be tested.
3. The detection method according to claim 2, characterized in that The determining of the region of interest from the image to be tested comprises: The region of interest is determined from the image to be tested by an adaptive threshold segmentation and extraction method.
4. The detection method according to claim 2, characterized in that The determining of the region of interest from the image to be tested comprises: Presetting a template image, wherein a region of interest is set on the template image; The template image is matched with the image to be tested, and the region of interest is determined from the image to be tested according to the matching result.
5. The detection method according to claim 2, characterized in that: The step of dividing the image to be tested into at least two images to be calculated based on the geometric features of the region of interest and the rubber path to be tested includes: Cropping the image to be tested based on the region of interest to obtain a region of interest image; The image of the region of interest is segmented based on the geometric features of the rubber path to be measured to obtain the image to be calculated.
6. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the glue path detection method as described in any one of claims 1 to 5 is implemented.
7. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method for detecting a glue path as described in any one of claims 1 to 5 is implemented.
