Laser etching shell quality detection method and device, electronic equipment and storage medium

Abstract

The invention discloses a laser etching shell quality detection method which comprises the following steps: acquiring a laser etching standard image of a standard laser etching shell after laser etching, and identifying an area in the laser etching standard image; according to the color of the bounding box of each area, information in the bounding box is recognized through a first image recognition method or a second image recognition method, and a laser etching standard sample image is generated; obtaining a product image of the to-be-detected laser etching shell; matching the laser etching standard sample image with the product image, and judging whether a corresponding required matching degree is met or not according to the color of the bounding box to be detected; if yes, the detection is passed. The laser etching standard sample image can be automatically generated, and the quality detection efficiency and reliability are improved. Therefore, matching and comparison between the to-be-detected product image and the standard image are automatically completed subsequently, and objectivity and consistency of product quality judgment are ensured. The invention further discloses a device for implementing the method, electronic equipment and a computer readable storage medium.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of image recognition, and in particular to a laser-engraved shell quality detection method and device, electronic equipment and a storage medium. BACKGROUND

[0002] With the rapid development of industrial automation and informatization, various electronic components play a crucial role in product traceability, production management and quality control. As a kind of key electronic components, signal converters usually have basic information such as model number, serial number, production date and two-dimensional code engraved on the shell by laser engraving process. This non-contact processing method has the advantages of high precision, permanence, no consumables, etc., and has become the mainstream technology of industrial marking. Laser engraving process has become the mainstream technology of electronic product marking due to its clear marking, permanent wear resistance, non-contact processing and environmental protection.

[0003] At present, the industry generally adopts manual inspection method for laser engraving process quality inspection. The specific process is as follows: the operator takes each signal converter product in turn on the production line, and under specific lighting conditions, carefully observes the laser engraving content on the shell with naked eye, checks whether the characters are complete and clear, and whether there are defects such as missing engraving, wrong engraving, blur, deformation, uneven depth or overburning, and manually records the inspection results. However, the manual inspection method has the following disadvantages: first, it consumes a lot of manpower, has low inspection efficiency and increases production cost; second, the inspection results are easily affected by the subjective factors of the inspectors, and there is a risk of misjudgment and omission, which makes it difficult to ensure the uniformity of the inspection standard and the reliability of the results. SUMMARY

[0004] In order to solve the above problems in the prior art, the present application provides a laser-engraved shell quality detection method, device, electronic equipment and storage medium. The technical problem to be solved by the present application is solved by the following technical scheme: The first aspect of the embodiment of the present application provides a laser-engraved shell quality detection method, comprising the following steps: A laser-engraved standard image of a standard laser-engraved shell is obtained, and the device parameter region, circuit diagram region, manufacturer information region and additional information region in the laser-engraved standard image are identified, and a laser-engraved standard image labeled with a boundary box is output; wherein the boundary box of each region is identified by a color, and each color indicates the required matching degree of each region; According to the color of the boundary box of each region, information in the boundary box is identified by using a first image recognition method or a second image recognition method to generate a laser etching standard sample image; wherein the first image recognition method is to identify the content of the text in the boundary box, and the identification result is marked by using the color of the boundary box of the region; the second image recognition method is to determine the circumscribed rectangle of the text in the boundary box by using a text detection algorithm, and the color of the rectangle is the same as the color of the boundary box of the region where the Chinese character is located; Obtain a product image of a to-be-inspected laser etching shell after laser etching; Perform global registration and coordinate mapping on the laser etching standard sample image and the product image to obtain a registration image marked with a to-be-inspected boundary box; According to the color of the to-be-inspected boundary box, information in the to-be-inspected boundary box is identified by using a first image recognition method or a second image recognition method to generate a first to-be-inspected image area and a second to-be-inspected image area; According to the color of the to-be-inspected boundary box, the first to-be-inspected image area and the second to-be-inspected image area, it is judged whether the corresponding requirement matching degree is met; If it is met, information that the to-be-inspected laser etching shell corresponding to the product image passes the detection is output.

[0005] In an embodiment of the present application, the color of the boundary box of the device parameter region indicates the highest requirement matching degree, and the color of the boundary box of the additional information region indicates the lowest requirement matching degree.

[0006] In an embodiment of the present application, whether the corresponding requirement matching degree is met according to the color of the to-be-inspected boundary box, the first to-be-inspected image area and the second to-be-inspected image area comprises: According to the first to-be-inspected image area, the character matching degree of the laser etching standard sample image and the first to-be-inspected image area is determined; According to the second to-be-inspected image area, the secondary matching degree of the laser etching standard sample image and the corresponding region of the second to-be-inspected image area is determined; It is judged whether the character matching degree is equal to the requirement matching degree corresponding to the color of the to-be-inspected boundary box, and whether the secondary matching degree is greater than or equal to the requirement matching degree corresponding to the color of the to-be-inspected boundary box.

[0007] In an embodiment of the present application, if it is met, the information that the to-be-inspected laser etching shell corresponding to the product image passes the detection is output, comprising: When the character matching degree is equal to the corresponding requirement matching degree, and the secondary matching degree is greater than or equal to the corresponding requirement matching degree, the information that the to-be-inspected laser etching shell corresponding to the product image passes the detection is output.

[0008] The second aspect of the embodiment of the present application provides a laser-engraved shell quality detection device, comprising: The first acquisition module is configured to acquire a laser-engraved standard image of a standard laser-engraved shell after laser engraving, identify a device parameter region, a circuit diagram region, a manufacturer information region and an additional information region in the laser-engraved standard image, and output the laser-engraved standard image labeled with a bounding box; wherein the bounding box of each region is identified by a color, and each color indicates a required matching degree of each region; The first identification module is configured to identify information in the bounding box according to the color of the bounding box of each region by using a first image identification method or a second image identification method, and generate a laser-engraved standard sample image; wherein the first image identification method is to identify the content of the text in the bounding box, and the identification result is identified by the color of the bounding box of the region; and the second image identification method is to determine a circumscribed rectangle of the text in the bounding box by using a text detection algorithm, and the color of the rectangle is the same as the color of the bounding box of the region where the Chinese character is located; The second acquisition module is configured to acquire a product image of a to-be-detected laser-engraved shell after laser engraving; The registration module is configured to globally register and coordinate map the laser-engraved standard sample image and the product image, and obtain a registration image labeled with a to-be-detected bounding box; The second identification module is configured to identify information in the to-be-detected bounding box according to the color of the to-be-detected bounding box by using the first image identification method or the second image identification method, and generate a first to-be-detected image area and a second to-be-detected image area; The judgment module is configured to judge whether the corresponding required matching degrees are met according to the color of the to-be-detected bounding box, the first to-be-detected image area and the second to-be-detected image area; The output module is configured to output information that the to-be-detected laser-engraved shell corresponding to the product image is detected to be qualified if the corresponding required matching degrees are met.

[0009] In an embodiment of the present application, the color of the bounding box of the device parameter region indicates the highest required matching degree, and the color of the bounding box of the additional information region indicates the lowest required matching degree.

[0010] In an embodiment of the present application, the judgment whether the corresponding required matching degrees are met according to the color of the to-be-detected bounding box, the first to-be-detected image area and the second to-be-detected image area comprises: determining a character matching degree of the laser-engraved standard sample image and the first to-be-detected image area according to the first to-be-detected image area; determining a secondary matching degree of the laser-engraved standard sample image and a corresponding region of the second to-be-detected image area according to the second to-be-detected image area; determining whether the character matching degree is equal to a required matching degree corresponding to the color of the to-be-inspected bounding box and whether the secondary matching degree is greater than or equal to the required matching degree corresponding to the color of the to-be-inspected bounding box.

[0011] In an embodiment of the present application, if the condition is met, information that the to-be-inspected laser-engraved shell corresponding to the product image passes the detection is output, including: When the character matching degree is equal to the corresponding required matching degree and the secondary matching degree is greater than or equal to the corresponding required matching degree, information that the to-be-inspected laser-engraved shell corresponding to the product image passes the detection is output.

[0012] A third aspect of the embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the method for detecting the quality of the laser-engraved shell provided in the first aspect of the embodiment of the present application when executing the program.

[0013] A fourth aspect of the embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and the computer program is executable on a processor to implement the method for detecting the quality of the laser-engraved shell provided in the first aspect of the embodiment of the present application.

[0014] The present application has the following beneficial effects: The present application obtains the laser-engraved standard sample image by processing and recognizing the laser-engraved standard image of the standard laser-engraved shell, and the corresponding laser-engraved standard sample image can be automatically generated when the quality of each batch of products is compared, thereby improving the quality detection efficiency and reliability. The processing and comparison of the to-be-inspected product image are automatically completed subsequently, the product quality inspection time is significantly shortened, and the overall production efficiency is greatly improved. The present application adopts a differentiated threshold matching strategy based on color coding, and a preset fixed mathematical standard is used to replace subjective and volatile human eye judgment. Regardless of how long the device runs, the judgment standard for the same defect remains constant, ensuring the objectivity and consistency of product quality judgment, and improving the product quality from the source.

[0015] Other features and advantages of the present application will be further described in the following specification, and some will become apparent from the specification, or will be understood from the practice of the present application. The purposes and other advantages of the present application can be achieved and obtained by the structures specifically pointed out in the written specification, claims, and drawings.

[0016] The technical solutions of the present application will be further described in detail below with the help of the drawings and embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0017] The accompanying drawings are included to provide a further understanding of the application, and are incorporated in and constitute a part of the specification, illustrate embodiments of the application, and are used to explain the present application, but are not intended to limit the present application. In the drawings: Figure 1 A flowchart of a laser-engraved shell quality detection method provided by an embodiment of the present application is shown in the figure. Figure 2 A schematic diagram of a laser-engraved shell quality detection device provided by an embodiment of the present application is shown in the figure. DETAILED DESCRIPTION

[0018] The present application will be further described in detail below with reference to specific embodiments, but the embodiments of the present application are not limited thereto.

[0019] As shown in the figure, the first aspect of the embodiment of the present application provides a laser-engraved shell quality detection method, including the following steps: Figure 1 Step 11, obtaining a laser-engraved standard image of a standard laser-engraved shell after laser engraving, identifying the device parameter region, circuit diagram region, manufacturer information region and additional information region in the laser-engraved standard image, and outputting the laser-engraved standard image labeled with a bounding box.

[0020] Among them, the bounding box of each region is marked with a color respectively, and each color indicates the required matching degree of each region.

[0021] Step 12, identifying the information in the bounding box according to the color of the bounding box of each region using a first image recognition method or a second image recognition method, and generating a laser-engraved standard sample image.

[0022] Among them, the first image recognition method is to identify the content of the text in the bounding box, and the identification result is marked with the color of the bounding box of the region; the second image recognition method is to determine the circumscribed rectangle of the text in the bounding box using a text detection algorithm, and the color of the rectangle is the same as the color of the bounding box of the region where the Chinese character is located.

[0023] Step 13, obtaining a product image of a to-be-inspected laser-engraved shell after laser engraving.

[0024] Step 14, globally registering and mapping coordinates between the laser-engraved standard sample image and the product image to obtain a registered image labeled with a to-be-inspected bounding box.

[0025] Step 15, identifying the information in the to-be-inspected bounding box according to the color of the to-be-inspected bounding box using the first image recognition method or the second image recognition method, and generating a first to-be-inspected image and a second to-be-inspected image.

[0026] Step 16, judging whether the corresponding required matching degree is met according to the color of the to-be-inspected bounding box, the first to-be-inspected image and the second to-be-inspected image. ​

[0027] Step 17, if satisfied, the to-be-detected image corresponds to the to-be-detected laser-engraved shell detection passes.

[0028] In this embodiment, the laser-engraved standard sample image is obtained by processing and recognizing the laser-engraved standard image of the standard laser-engraved shell. The corresponding laser-engraved standard sample image can be automatically generated when each batch of products is compared for quality, improving the quality detection efficiency and reliability. Subsequent processing and comparison of the to-be-detected product image are automatically completed, significantly shortening the product quality inspection time and greatly improving the overall production efficiency. The embodiment adopts a differentiated threshold matching strategy based on color coding, replacing subjective and volatile human eye judgment with a preset and fixed mathematical standard. Regardless of how long the device runs, the judgment standard for the same defect remains constant, ensuring the absolute objectivity and high consistency of product quality judgment, and improving the product quality from the source.

[0029] As shown in Figure 2 Based on the first aspect of the embodiment of the present application, the second aspect of the present application further details a laser-engraved shell quality detection method. The second aspect of the present application provides a laser-engraved shell quality detection method, including the following steps: Step 21, obtaining a laser-engraved standard image of a standard laser-engraved shell after laser engraving, identifying the device parameter region, circuit diagram region, manufacturer information region, and additional information region in the laser-engraved standard image, and outputting the laser-engraved standard image labeled with the boundary box of each region.

[0030] In this embodiment, the laser-engraved standard sample image is obtained by processing and recognizing the laser-engraved standard image of the standard laser-engraved shell. The corresponding laser-engraved standard sample image can be automatically generated when each batch of products is compared for quality, improving the quality detection efficiency and reliability. Subsequent processing and comparison of the to-be-detected product image are automatically completed, significantly shortening the product quality inspection time and greatly improving the overall production efficiency. The embodiment adopts a differentiated threshold matching strategy based on color coding, replacing subjective and volatile human eye judgment with a preset and fixed mathematical standard. Regardless of how long the device runs, the judgment standard for the same defect remains constant, ensuring the absolute objectivity and high consistency of product quality judgment, and improving the product quality from the source.

[0031] In this step, the standard laser-engraved shell can be a standard sample shell made in advance, or a product with better laser-engraving quality selected manually from previously laser-engraved products. The standard laser-engraved shell is imaged to obtain a laser-engraved standard image, and then the laser-engraved standard image is preprocessed such as noise reduction, contrast enhancement, and binarization.

[0032] The regions in the pre-processed laser-engraved standard image are divided, and the boundary boxes of the device parameter region, the circuit diagram region, the manufacturer information region, and the additional information region are respectively output by using OpenCV findContours (contour finding) or a target detection model (such as YOLO, Faster R-CNN) + a machine learning classifier, and the boundary boxes of the multiple regions adopt different colors. The boundary box is the maximum range boundary of the region. For example, the boundary box of the device parameter region adopts yellow, and this region is an important information region, requiring a matching degree of 100%, the boundary box of the circuit diagram region is green, and this region is a less important region, requiring a matching degree of 95%, the boundary box of the additional information region is orange, requiring a matching degree of 90%, and the boundary box of the manufacturer information region is blue, and the information in this region is relatively unimportant, requiring the lowest matching degree. Therefore, the requirement matching degree corresponding to the yellow boundary box is 100%, the requirement matching degree corresponding to the green boundary box is 95%, the requirement matching degree corresponding to the orange boundary box is 90%, and the requirement matching degree corresponding to the blue boundary box is 80%.

[0033] In step 22, the information in the boundary box is identified by using the first image recognition method or the second image recognition method according to the color of the boundary box of each region, and a laser-engraved standard sample image is generated.

[0034] The first image recognition method is to identify the content of the text in the boundary box, such as Chinese characters, numbers, symbols, and English characters, and the identification result is marked with the color of the boundary box of the region; the second image recognition method is to determine the bounding rectangle of the text in the boundary box by using a text detection algorithm, and the color of the rectangle is the same as the color of the boundary box of the Chinese character region.

[0035] In this step, for regions with high matching degree requirements, that is, regions framed by a boundary box of a certain color, the first image recognition method is used to accurately identify each character or symbol, and the characters or symbols are marked with the color of the corresponding boundary box, and a first sample area is obtained. The image is used as a standard to compare and match subsequent products. If the matching meets the requirement matching degree, the quality inspection is passed.

[0036] For regions with low matching degree requirements, EAST or CTPN text detection algorithm is used to accurately position the bounding rectangle of each text. The rectangle located in the boundary box completely inherits the color attribute of the boundary box. Here, the color of the rectangle located in the boundary box is the same as the color of the boundary box. Since the content of the text is not the most important information for other information of the shell, it is not necessary to identify the specific text, and only the bounding rectangle is identified, and a second sample area is obtained.

[0037] Here, for a given region, whether to use the first or second image recognition method depends on the color of the region's bounding box. Each color corresponds to a required matching degree, thus corresponding to one of the image recognition methods. Regions with high required matching degrees use the first image recognition method, while regions with low required matching degrees use the second image recognition method. For example, a red bounding box indicates the highest required matching degree, so the content within the region enclosed by the red bounding box is recognized using the first image recognition method. Bounding boxes of other colors indicate lower required matching degrees, and are recognized using the second image recognition method. After recognition, a laser-engraved standard sample image is output. The laser-engraved standard sample image includes a first sample area recognized using the first recognition method and a second sample area recognized using the second recognition method. Even if multiple regions use the second recognition method, the required matching degree of the resulting images is related to the color of their respective bounding boxes. For example, if multiple bounding boxes are recognized using the second recognition method, the required matching degrees of the resulting images will be different due to the different colors of their bounding boxes.

[0038] Step 23: Obtain the product image of the laser-engraved shell to be inspected.

[0039] Step 24: Perform global registration and coordinate mapping between the laser-engraved standard sample image and the product image to obtain a registered image with the bounding box to be inspected marked. Specifically, step 24 includes steps 241-245: In this step, alignment is required because of the spatial differences between the product image and the laser-engraved standard sample image caused by shooting angle and distance.

[0040] Step 241: Laser engrave the standard sample image. Use feature detection algorithms (such as SIFT, SURF, ORB) to extract keypoint sets. Each key point Including its coordinates in the image and feature descriptor vectors .

[0041] Product images Use feature detection algorithms (such as SIFT, SURF, ORB) to extract keypoint sets. Each key point Including its coordinates in the image and feature descriptor vectors .

[0042] Step 242, calculate a and The Euclidean distance.

[0043] Step 243: Analyze the feature descriptor vectors in the laser-engraved standard sample image. Find the matching element among all feature descriptor vectors of the product image. The feature descriptor vector closest to the Euclidean distance is denoted as... ,Will and the corresponding coordinates in the image This serves as an initial set of matching point pairs. After all feature descriptor vectors have been computed, the initial set of matching point pairs is obtained. M .

[0044] Step 244, for any point Its transformed coordinates It can be calculated using the following formula: This represents the affine transformation matrix between two images. Robust estimation algorithms such as Random Sample Consensus (RANSAC) are used to estimate the values ​​from the set of matching point pairs. M The algorithm iteratively searches for a set of inliers and solves for the affine transformation matrix that minimizes the sum of squared reprojection errors of the inliers. .

[0045] in It is the set of interior point matching pairs after RANSAC filtering.

[0046] Step 245: For the coordinates of the bounding box in the laser-engraved standard sample image, use the obtained optimal transformation matrix. By performing a coordinate transformation and inheriting the color attributes from the laser-engraved standard sample image, the bounding box in the laser-engraved standard sample image is mapped to the coordinate system of the product image, resulting in a registered image with a colored border. The border in the registered image is denoted as the bounding box to be inspected.

[0047] Step 25: Based on the color of the bounding box to be inspected, the information within the bounding box to be inspected is identified using either the first image recognition method or the second image recognition method to generate the first image area to be inspected and the second image area to be inspected.

[0048] In this step, after obtaining the registered image, the same method as in step 22 is used to identify information within the region. Similarly, the corresponding image recognition method is used to identify the region based on the color of the border to be inspected. The first image recognition method identifies the first region to be inspected, and the second recognition method identifies the second region to be inspected. The first region to be inspected is the region requiring a high degree of matching.

[0049] Step 26: Determine whether the matching degree is met based on the color of the bounding box to be inspected, the first image area to be inspected, and the second image area to be inspected.

[0050] Step 26 includes steps 261-263: Step 261: Determine the character matching degree between the laser-engraved standard sample image and the first image area to be inspected based on the first image area to be inspected.

[0051] In this step, the first image area to be inspected is matched and compared with the corresponding area of ​​the laser-engraved standard sample; that is, the first image area to be inspected is compared with the first sample area of ​​the laser-engraved standard sample. Specifically, step 261 includes steps A1-A3: Step A1: Binarize the first sample area and the first image area to be inspected to obtain the first sample binarized image and the first image to be inspected, respectively.

[0052] Step A2: Calculate the binarized image of the first sample. And the first binarized image to be detected The absolute value of the difference between corresponding pixels .

[0053] In this step, ,in, Represents a pixel.

[0054] There are two situations here, one is... ,but In position Above, the pixel states of the two images are completely identical, indicating that they are matched pixels.

[0055] Another one is ,but In position The pixel states in the two images are inconsistent, indicating mismatched pixels.

[0056] Step A3, based on the absolute value of the difference Determine character matching degree .

[0057] Specifically, character matching degree The calculation formula is as follows: in, Represents the binarized image of the first sample. The total number of pixels of the Chinese characters Indicates Based on the Chinese character, traverse For each corresponding pixel in the image, assign them their respective... The sum of all values ​​represents the binarized image of the first sample. And the first binarized image to be detected The total number of non-matching pixels between characters. 1 - the proportion of the total number of non-matching pixels to the total number of pixels of the characters. This gives the proportion of matching pixels, which is the character matching degree.

[0058] Generally, there is only one first image area to be inspected, which is the device parameter area outlined by a border of a certain color.

[0059] Step 262: Determine the secondary matching degree of the corresponding areas of the laser-engraved standard sample image and the second image area to be inspected based on the second image area to be inspected.

[0060] In this step, the second image area to be inspected and the second sample area are matched. Specifically, the area and perimeter of the bounding rectangle of each line of text in the second sample area are calculated. Here, the total area and perimeter of a line of text are calculated, while the edges of overlapping bounding rectangles are not calculated. Similarly, the area and perimeter of the bounding rectangle of each line of text in the second image area to be inspected are calculated. Then, the areas of each line in the second image area to be inspected are added together to obtain the total area to be inspected, and the perimeters of each line are added together to obtain the total perimeter to be inspected. Similarly, the area and perimeter of the second sample area are added together to obtain the standard total area and standard total perimeter. After that, the ratio of the total area to be inspected to the standard total area is calculated and multiplied by 100% to obtain the secondary matching degree of area, and the ratio of the total perimeter to be inspected to the standard total perimeter is calculated and multiplied by 100% to obtain the secondary matching degree of perimeter.

[0061] Here, there can be multiple second image regions to be inspected, and each second image region to be inspected calculates its own secondary matching degree corresponding to the corresponding second sample region.

[0062] Step 263: Determine whether the character matching degree is equal to the required matching degree corresponding to the color of the bounding box to be inspected, and whether the secondary matching degree is greater than or equal to the required matching degree corresponding to the color of the bounding box to be inspected.

[0063] In this step, the color indicator of the bounding box of the image area to be inspected, corresponding to the character matching degree identified and calculated using the first recognition method, has the highest required matching degree, which can be set to 100%. The color indicator of the bounding box of the image area to be inspected, corresponding to the secondary matching degree identified and calculated using the second recognition method, has a lower required matching degree, below 100%. At the same time, different colors of the bounding box to be inspected correspond to different required matching degrees, such as required matching degrees of 90%, 95%, 80%, etc., which can be set according to actual needs.

[0064] Step 27: If the conditions are met, the laser-engraved shell corresponding to the image to be inspected passes the inspection.

[0065] In this step, when the character matching degree is equal to the corresponding required matching degree, and the secondary matching degree is greater than or equal to the corresponding required matching degree, the laser-engraved shell corresponding to the product image passes the inspection and the product is qualified.

[0066] Here, the area secondary matching degree and the perimeter secondary matching degree must both be greater than or equal to the corresponding required matching degree.

[0067] If the character matching degree is less than the corresponding required matching degree, or the secondary matching degree is less than the corresponding required matching degree, the laser engraving shell corresponding to the product image will fail the inspection and the product will be unqualified.

[0068] like Figure 2 As shown, a third aspect of the present invention provides a laser-engraved shell quality inspection device, comprising: The first acquisition module 31 is used to acquire the laser-engraved standard image of the standard laser-engraved shell, identify the equipment parameter area, circuit diagram area, manufacturer information area and additional information area in the laser-engraved standard image, and output the laser-engraved standard image marked with bounding boxes; wherein, the bounding box of each area is marked with a different color, and each color indicates the required matching degree of each area; The first recognition module 32 is used to recognize the information within the bounding box using a first image recognition method or a second image recognition method based on the color of the bounding box of each region, and generate a laser engraving standard sample image; wherein, the first image recognition method is to recognize the content of the text within the bounding box and mark the recognition result using the color of the bounding box of the region; the second image recognition method is to use a text detection algorithm to determine the bounding rectangle of the text within the bounding box, and the color of the rectangle is the same as the color of the bounding box of the region where the Chinese character is located; The second acquisition module 33 is used to acquire the product image of the laser-engraved shell to be inspected after laser engraving. The registration module 34 is used to perform global registration and coordinate mapping between the laser-engraved standard sample image and the product image to obtain a registered image with the bounding box to be inspected marked. The second recognition module 35 is used to recognize the information inside the bounding box to be inspected according to the color of the bounding box to be inspected using the first image recognition method or the second image recognition method, and generate the first image area to be inspected and the second image area to be inspected. The judgment module 36 is used to determine whether the matching degree required is met based on the color of the bounding box to be inspected, the first image area to be inspected, and the second image area to be inspected. Output module 37 is used to output information indicating that the laser-engraved shell to be inspected has passed inspection if the conditions are met.

[0069] In one embodiment of the present invention, the color indication of the bounding box of the device parameter area has the highest required matching degree, while the color indication of the bounding box of the supplementary information area has the lowest required matching degree.

[0070] In one embodiment of the present invention, determining whether a corresponding matching degree is met based on the color of the bounding box to be inspected, the first image area to be inspected, and the second image area to be inspected includes: The character matching degree between the laser-engraved standard sample image and the first image area to be inspected is determined based on the first image area to be inspected. The secondary matching degree of the corresponding areas of the laser-engraved standard sample image and the second image area to be inspected is determined based on the second image area to be inspected; Determine whether the character matching degree is equal to the required matching degree corresponding to the color of the bounding box to be inspected, and whether the secondary matching degree is greater than or equal to the required matching degree corresponding to the color of the bounding box to be inspected.

[0071] In one embodiment of the present invention, if the conditions are met, information indicating that the laser-engraved outer shell corresponding to the product image has passed inspection is output, including: When the character matching degree is equal to the corresponding required matching degree, and the secondary matching degree is greater than or equal to the corresponding required matching degree, the output message is that the laser-engraved shell corresponding to the product image has passed the inspection.

[0072] A third aspect of the present invention provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements the laser engraving shell quality inspection method provided by the present invention described above.

[0073] A fourth aspect of the present invention also provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the laser-engraved shell quality inspection method provided in the above-described embodiments of the present invention.

[0074] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.

[0075] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware devices.

[0076] The method provided in this invention can be applied to electronic devices. Specifically, the electronic device can be a desktop computer, a portable computer, a smart mobile terminal, a server, etc. No limitation is made herein; any electronic device that can implement this invention falls within the protection scope of this invention.

[0077] For the device / electronic device embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and relevant parts can be referred to in the description of the method embodiments.

[0078] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0079] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0080] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0081] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A method for inspecting the quality of laser-engraved shells, characterized in that, Includes the following steps: A standard laser-engraved image of the standard laser-engraved shell is obtained. The device parameter area, circuit diagram area, manufacturer information area, and additional information area in the standard laser-engraved image are identified, and a standard laser-engraved image marked with bounding boxes is output. Each area's bounding box is marked with a different color, and each color indicates the required matching degree for each area. Based on the color of the bounding box of each region, the information within the bounding box is identified using a first image recognition method or a second image recognition method to generate a laser engraving standard sample image; wherein, the first image recognition method identifies the content of the text within the bounding box and marks the recognition result using the color of the bounding box of the region; the second image recognition method uses a text detection algorithm to determine the bounding rectangle of the text within the bounding box, and the color of the rectangle is the same as the color of the bounding box of the region where the Chinese character is located. Obtain product images of the laser-engraved shell to be inspected; The laser-engraved standard sample image and the product image are globally registered and mapped to obtain a registered image with the bounding box to be inspected marked. Based on the color of the bounding box to be inspected, the information within the bounding box to be inspected is identified using a first image recognition method or a second image recognition method to generate a first image area to be inspected and a second image area to be inspected. Determine whether the corresponding matching degree requirement is met based on the color of the bounding box to be inspected, the first image area to be inspected, and the second image area to be inspected; If the conditions are met, the output will show that the laser-engraved shell corresponding to the product image has passed the inspection.

2. The method as described in claim 1, characterized in that, The color indication of the bounding box in the device parameter area has the highest required matching degree, while the color indication of the bounding box in the additional information area has the lowest required matching degree.

3. The method as described in claim 2, characterized in that, The step of determining whether the matching degree requirement is met based on the color of the bounding box to be inspected, the first image area to be inspected, and the second image area to be inspected includes: The character matching degree between the laser-engraved standard sample image and the first image area to be inspected is determined based on the first image area to be inspected. The secondary matching degree of the corresponding regions of the laser-engraved standard sample image and the second image area to be inspected is determined based on the second image area to be inspected; Determine whether the character matching degree is equal to the required matching degree corresponding to the color of the bounding box to be inspected, and whether the secondary matching degree is greater than or equal to the required matching degree corresponding to the color of the bounding box to be inspected.

4. The method as described in claim 3, characterized in that, If the conditions are met, the output information indicating that the laser-engraved shell corresponding to the product image has passed the inspection includes: When the character matching degree is equal to the corresponding required matching degree, and the secondary matching degree is greater than or equal to the corresponding required matching degree, the information that the laser-engraved shell corresponding to the product image has passed the inspection is output.

5. A laser-engraved shell quality inspection device, characterized in that, include: The first acquisition module is used to acquire the laser-engraved standard image of the standard laser-engraved shell, identify the equipment parameter area, circuit diagram area, manufacturer information area and additional information area in the laser-engraved standard image, and output the laser-engraved standard image marked with bounding boxes; wherein, the bounding box of each area is marked with a different color, and each color indicates the required matching degree of each area; The first recognition module is used to recognize the information within the bounding box of each region using a first image recognition method or a second image recognition method, based on the color of the bounding box of each region, to generate a laser engraving standard sample image; wherein, the first image recognition method is to recognize the content of the text within the bounding box and mark the recognition result using the color of the bounding box of the region; the second image recognition method is to use a text detection algorithm to determine the bounding rectangle of the text within the bounding box, and the color of the rectangle is the same as the color of the bounding box of the region where the Chinese character is located. The second acquisition module is used to acquire product images of the laser-engraved shell to be inspected after laser engraving. The registration module is used to perform global registration and coordinate mapping between the laser-engraved standard sample image and the product image to obtain a registered image with the bounding box to be inspected. The second recognition module is used to recognize the information within the bounding box to be inspected using a first image recognition method or a second image recognition method based on the color of the bounding box to be inspected, and to generate a first image area to be inspected and a second image area to be inspected. The judgment module is used to determine whether the corresponding matching degree requirement is met based on the color of the bounding box to be inspected, the first image area to be inspected, and the second image area to be inspected. The output module is used to output information indicating that the laser-engraved shell corresponding to the product image has passed the inspection if the conditions are met.

6. The apparatus as claimed in claim 5, characterized in that, The color indication of the bounding box in the device parameter area has the highest required matching degree, while the color indication of the bounding box in the additional information area has the lowest required matching degree.

7. The apparatus as claimed in claim 6, characterized in that, The step of determining whether the matching degree requirement is met based on the color of the bounding box to be inspected, the first image area to be inspected, and the second image area to be inspected includes: The character matching degree between the laser-engraved standard sample image and the first image area to be inspected is determined based on the first image area to be inspected. The secondary matching degree of the corresponding regions of the laser-engraved standard sample image and the second image area to be inspected is determined based on the second image area to be inspected; Determine whether the character matching degree is equal to the required matching degree corresponding to the color of the bounding box to be inspected, and whether the secondary matching degree is greater than or equal to the required matching degree corresponding to the color of the bounding box to be inspected.

8. The apparatus as claimed in claim 7, characterized in that, If the conditions are met, the output information indicating that the laser-engraved shell corresponding to the product image has passed the inspection includes: When the character matching degree is equal to the corresponding required matching degree, and the secondary matching degree is greater than or equal to the corresponding required matching degree, the information that the laser-engraved shell corresponding to the product image has passed the inspection is output.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the laser-engraved shell quality inspection method as described in any one of claims 1 to 4.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the laser-engraved shell quality inspection method according to any one of claims 1 to 4.

Images