Automatic optical detection method, system, device and storage medium for die-cutting machine

Abstract

The present application relates to the technical field of image recognition, and discloses an automatic optical detection method, system, equipment and storage medium applied to a die-cutting machine. The method comprises determining the shape and position parameters of a workpiece, a raw material model and a processing type of a processing task, and setting an image cropping area to update an image cropping algorithm; obtaining a first optical detection image before the start of workpiece pressing and cutting and inputting it into an image preprocessing model, performing a correction cropping process to generate a first corrected image; intercepting a stage finished product area image from the first corrected image and comparing it with a corresponding raw material reference image to generate feed specification information, and generating a pressing and cutting start instruction when the feed specification information is qualified; obtaining a second optical detection image after the workpiece is pressed and cut, preprocessing to generate a second corrected image and intercepting a stage finished product pattern and a stage finished product boundary therefrom to compare them with the corresponding finished product reference image and the boundary reference image to generate finished product specification information; the present application has the effect of improving the timeliness of detection of die-cutting quality problems.

Description

Technical Field

[0001] The present application relates to the technical field of image recognition, and in particular to an automatic optical detection method, system, device and storage medium for a die-cutting machine. Background Art

[0002] Die-cutting machines are widely used for cutting workpieces such as plates and sheets, and can also be used for manufacturing processes such as indentation, hot stamping, and material bonding. During the use of die-cutting machines, common processing quality problems include inaccurate positioning of workpieces, deformation of workpieces, damage to tools, dirty plates and sheets to be processed, etc. At present, the detection method for such quality problems is usually determined after inspecting the finished workpieces, and the discovery of quality problems has a large lag, making it difficult to timely discover quality problems and maintain the equipment during the processing process. Therefore, the above-mentioned related technologies have the problem of poor timeliness in detecting die-cutting quality problems. Summary of the invention

[0003] In order to improve the timeliness of die-cutting quality problem detection, the present application provides an automatic optical detection method, system, device and storage medium for a die-cutting machine.

[0004] The first invention objective of this application is achieved by adopting the following technical solution:

[0005] An automatic optical inspection method for a die-cutting machine comprising:

[0006] Determine the workpiece shape and position parameters, raw material model, and processing type of the current processing task, and set the image cropping area of ​​the current processing task based on the workpiece shape and position parameters to update the image cropping algorithm;

[0007] Before the workpiece cutting begins, a first optical detection image of the cutting surface is obtained and input into a preset image preprocessing model, and correction and cropping are performed to generate a first corrected image;

[0008] Based on the workpiece shape and position parameters, a stage finished product area image is intercepted from the first corrected image, the stage finished product area image is compared with a raw material reference image corresponding to the raw material model, and feeding specification information is generated, and when the feeding specification information is qualified, a pressing and cutting start instruction is generated;

[0009] After the workpiece is pressed and cut, a second optical detection image is obtained, and a second corrected image is generated after preprocessing. A stage finished product pattern and a stage finished product boundary are intercepted from the second corrected image based on the workpiece shape and position parameters, and the stage finished product pattern and the stage finished product boundary are compared with the finished product reference image and the boundary reference image corresponding to the processing type to generate finished product specification information;

[0010] The die-cutting machine is provided with an imaging component for photographing the die-cutting plate to obtain an optical detection image; the image preprocessing model is built with a perspective correction algorithm and an image cropping algorithm.

[0011] By adopting the above technical scheme, the workpiece shape and position parameters, raw material model, and processing type of the current die-cutting machine processing task are determined, so as to subsequently determine the image cropping area and reduce the computer resource consumption for image recognition of invalid areas; before the workpiece pressing and cutting begins, the first optical detection image of the pressing and cutting layout is obtained and input into the image preprocessing model, so as to perform perspective correction and image cropping on the first optical detection image to obtain a first corrected image, which is convenient for subsequent image comparison; according to the workpiece shape and position parameters, the stage finished product area image is intercepted from the first corrected image, and compared with the raw material reference image corresponding to the raw material model, so as to generate feeding specification information, and when the feeding specification information is qualified, the pressing and cutting start instruction is generated, so as to facilitate the suspension of the die-cutting machine in the case of unqualified raw materials to eliminate faults; after the workpiece is pressed and cut, the second optical detection image is obtained and preprocessed to obtain the second corrected image, and the stage finished product pattern and stage finished product boundary are intercepted from the second corrected image according to the workpiece shape and position parameters, and compared with the corresponding finished product reference image and boundary reference image, so as to generate finished product specification information, which is used to judge whether the finished product quality is qualified, thereby improving the timeliness of die-cutting quality problem detection.

[0012] In a preferred example of the present application, the determining of the workpiece shape and position parameters, material model, and processing type of the current processing task, and setting the image cropping area of ​​the current processing task based on the workpiece shape and position parameters to update the image cropping algorithm includes:

[0013] Receive processing setting information to set the processing program of the target die-cutting machine, and determine the workpiece shape and position parameters, raw material model, and processing type of the current processing task based on the processing setting information;

[0014] The shape information, size information and position information relative to the cutting surface of the finished product of the workpiece stage of the current processing task are determined based on the workpiece shape and position parameters, and the image cropping area of ​​the current processing task is set to update the image cropping algorithm.

[0015] By adopting the above technical solution, processing setting information is received to set the processing program of the target die-cutting machine, and the workpiece shape and position parameters, raw material model, processing type and other information corresponding to the current processing task are determined according to the processing setting information; the shape, size and position of the workpiece stage finished product of the current processing task relative to the cutting surface are determined based on the workpiece shape and position parameters, and then the image cropping area of ​​the current processing task is set to update the image cropping algorithm, so as to facilitate the subsequent use of the image cropping algorithm to crop the image taken from the cutting surface and optimize the image comparison efficiency.

[0016] In a preferred example of the present application, before the workpiece cutting begins, a first optical detection image of the cutting surface is obtained and input into a preset image preprocessing model, and correction and cropping are performed to generate a first corrected image, including:

[0017] When the raw material is delivered to the place and before the workpiece cutting begins, a first optical detection image taken by the imaging component is acquired and input into the image preprocessing model;

[0018] Obtaining the viewing angle information of the imaging component and the shooting orientation information of the lens axis relative to the pressed-cutting layout and loading them into the perspective correction algorithm, scaling the first optical detection image in different directions according to different scaling ratios through the perspective correction algorithm to generate a first scaled image;

[0019] An image cropping region is identified from the first zoomed image, and the first zoomed image is cropped based on the image cropping region to generate a first corrected image.

[0020] By adopting the above technical scheme, when the raw material is delivered to the place and before the workpiece cutting begins, the first optical detection image of the cutting surface taken by the imaging component is obtained and input into the image preprocessing model for subsequent preprocessing; the viewing angle information and shooting orientation information of the imaging component are obtained and loaded into the perspective correction algorithm to determine the image deformation caused by the perspective principle of the first optical detection image, and the first optical detection image is scaled in different directions at different scaling ratios by the perspective correction algorithm to generate a first scaled image, thereby reducing the image distortion caused by the perspective principle; the image cropping area is identified from the first scaled image to crop the first scaled image, thereby generating a first corrected image, which is convenient for subsequent image recognition and comparison.

[0021] In a preferred example of the present application, based on the workpiece shape and position parameters, the stage finished product area image is intercepted from the first corrected image, the stage finished product area image is compared with the raw material reference image corresponding to the raw material model, and the feed specification information is generated. When the feed specification information is qualified, a press-cut start instruction is generated, including:

[0022] Based on the shape and position parameters of the workpiece, the stage finished product area is determined according to the boundary position of the stage finished product of each workpiece, and the stage finished product area image is intercepted from the first corrected image;

[0023] Matching a corresponding raw material reference image from a preset comparison image library based on the raw material model;

[0024] Compare the stage finished product area image with the raw material reference image to determine whether there are abnormal image features in the stage finished product area image. If there are no abnormal image features, generate qualified feeding specification information, and generate a pressing and cutting start instruction and send it to the die-cutting controller;

[0025] The stage finished product area image completely covers the stage finished product pattern and the area where the stage finished product boundary is located.

[0026] By adopting the above technical scheme, the boundary position of each stage finished product of the workpiece is determined based on the shape and position parameters of the workpiece, and then the area of ​​the stage finished product of the workpiece in the first corrected image is determined to intercept the stage finished product area image; the image of the sheet raw material that meets the raw material model is matched from the preset comparison image library as the raw material reference image; the stage finished product area image is compared with the raw material reference image to determine whether there are abnormal image features in the stage finished product area image that are inconsistent with the raw material reference image. When no abnormal image features are found, it is considered that the quality of the sheet raw material in the stage finished product area image is qualified, so as to generate qualified feeding specification information, and generate a pressing and cutting start instruction and send it to the die-cutting controller to control the die-cutting machine to start die-cutting work.

[0027] In a preferred example of the present application, the method of intercepting a stage finished product pattern and a stage finished product boundary from the second corrected image based on the workpiece shape and position parameters, comparing the stage finished product pattern and the stage finished product boundary with the finished product reference image and the boundary reference image corresponding to the processing type, and generating finished product specification information includes:

[0028] Based on the shape and position parameters of the workpiece, the area where the staged product and the die-cutting boundary of the workpiece are located in the second corrected image is determined, so as to intercept the image of the corresponding area from the second corrected image to obtain the staged product pattern and the staged product boundary;

[0029] Based on the known raw material model and processing type, the corresponding finished product reference image and boundary reference image are matched from the preset comparison image library;

[0030] The stage finished product pattern is compared with the finished product reference image, and the stage finished product boundary is compared with the boundary reference image. If there are no abnormal image features in both, qualified finished product specification information is generated.

[0031] By adopting the above technical scheme, based on the workpiece shape and position parameters, the area where the workpiece stage finished product and the die-cutting boundary are located in the second corrected image is determined, so as to intercept the stage finished product pattern according to the area where the workpiece stage finished product is located in the second corrected image, and intercept the stage finished product boundary according to the area where the die-cutting boundary is located; based on the known raw material model and processing type, the workpiece stage finished product image and the die-cutting boundary image of the successful sample of the die-cutting work under the same working conditions are matched from the comparison image library as the finished product reference image and the boundary reference image; the stage finished product pattern is compared with the finished product reference image, and the stage finished product boundary is compared with the boundary reference image to determine whether the quality of the finished product of this die-cutting work is qualified. If no abnormal image features appear in the comparison process of the two images, qualified finished product specification information is generated, so as to facilitate the understanding that the current workpiece stage finished product processing quality is qualified.

[0032] The second invention objective of this application is achieved by the following technical solution:

[0033] An automatic optical detection system for a die-cutting machine, applied to any of the above-mentioned automatic optical detection methods for a die-cutting machine, comprises:

[0034] An image cropping algorithm update module is used to determine the workpiece shape and position parameters, raw material model, and processing type of the current processing task, and to set the image cropping area of ​​the current processing task based on the workpiece shape and position parameters to update the image cropping algorithm;

[0035] A first corrected image generation module is used to obtain a first optical detection image of the pressing and cutting surface before the workpiece pressing and cutting begins, and input it into a preset image preprocessing model to perform correction and cropping processing to generate a first corrected image;

[0036] A pressing and cutting start instruction generating module is used to intercept a stage finished product area image from the first corrected image based on the workpiece shape and position parameters, compare the stage finished product area image with a raw material reference image corresponding to the raw material model, generate feed specification information, and generate a pressing and cutting start instruction when the feed specification information is qualified;

[0037] The finished product specification information generating module is used to obtain the second optical detection image after the workpiece is pressed and cut, generate the second corrected image through preprocessing, intercept the stage finished product pattern and the stage finished product boundary from the second corrected image based on the workpiece shape and position parameters, compare the stage finished product pattern and the stage finished product boundary with the finished product reference image and the boundary reference image corresponding to the processing type, and generate the finished product specification information;

[0038] The die-cutting machine is provided with an imaging component for photographing the die-cutting plate to obtain an optical detection image; the image preprocessing model is built with a perspective correction algorithm and an image cropping algorithm.

[0039] In a preferred example of the present application: the image cropping algorithm update module includes:

[0040] The processing task analysis submodule is used to receive processing setting information to set the processing program of the target die-cutting machine, and determine the workpiece shape and position parameters, raw material model, and processing type of the current processing task based on the processing setting information;

[0041] The image cropping area setting submodule is used to determine the shape information, size information and position information relative to the cutting surface of the workpiece stage finished product of the current processing task based on the workpiece shape and position parameters, set the image cropping area of ​​the current processing task, and update the image cropping algorithm.

[0042] In a preferred example of the present application: the first corrected image generation module includes:

[0043] A first optical detection image acquisition submodule is used to acquire a first optical detection image taken by the imaging component and input it into an image preprocessing model when the raw material is delivered to the site and before the workpiece pressing and cutting begins;

[0044] A first zoomed image generation submodule is used to obtain the viewing angle information of the imaging component and the shooting orientation information of the lens axis relative to the pressing and cutting surface and load them into the perspective correction algorithm, and to perform zooming processing on the first optical detection image in different directions according to different zooming ratios through the perspective correction algorithm to generate a first zoomed image;

[0045] The scaled image cropping processing submodule is used to identify an image cropping area from the first scaled image, perform cropping processing on the first scaled image based on the image cropping area, and generate a first corrected image.

[0046] The third invention objective of this application is achieved by the following technical solution:

[0047] A computer device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the automatic optical detection method for a die-cutting machine when executing the computer program.

[0048] The fourth invention objective of this application is achieved by the following technical solution:

[0049] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the automatic optical detection method for a die-cutting machine are implemented.

[0050] In summary, the present application includes at least one of the following beneficial technical effects:

[0051] 1. Determine the workpiece shape and position parameters, raw material model, and processing type of the current die-cutting machine processing task, so as to determine the image cropping area in the future and reduce the computer resource consumption of image recognition for invalid areas; before the workpiece pressing and cutting begins, obtain the first optical detection image of the pressing and cutting layout and input it into the image preprocessing model, so as to perform perspective correction and image cropping on the first optical detection image to obtain the first corrected image, which is convenient for subsequent image comparison; intercept the stage finished product area image from the first corrected image according to the workpiece shape and position parameters, and compare it with the raw material reference image corresponding to the raw material model, so as to generate feeding specification information, and when the feeding specification information is qualified, generate a pressing and cutting start instruction, so as to suspend the operation of the die-cutting machine in the case of unqualified raw materials to eliminate faults; after the workpiece is pressed and cut, obtain the second optical detection image and perform preprocessing to obtain the second corrected image, intercept the stage finished product pattern and stage finished product boundary from the second corrected image according to the workpiece shape and position parameters, and compare it with the corresponding finished product reference image and boundary reference image, so as to generate finished product specification information, which is used to judge whether the finished product quality is qualified, thereby improving the timeliness of die-cutting quality problem detection.

[0052] 2. Receive processing setting information to set the processing program of the target die-cutting machine, and determine the workpiece shape and position parameters, raw material model, processing type and other information corresponding to the current processing task based on the processing setting information; determine the shape, size and position of the workpiece stage product of the current processing task relative to the cutting surface based on the workpiece shape and position parameters, and then set the image cropping area of ​​the current processing task to update the image cropping algorithm, so as to facilitate the subsequent use of the image cropping algorithm to crop the image taken from the cutting surface and optimize the image comparison efficiency.

[0053] 3. When the raw material is delivered to the site and before the workpiece cutting begins, the first optical detection image of the cutting surface taken by the imaging component is obtained and input into the image preprocessing model for subsequent preprocessing; the viewing angle information and shooting orientation information of the imaging component are obtained and loaded into the perspective correction algorithm to determine the image deformation caused by the perspective principle of the first optical detection image, and the first optical detection image is scaled in different directions at different scaling ratios by the perspective correction algorithm to generate a first scaled image to reduce the image distortion caused by the perspective principle; the image cropping area is identified from the first scaled image to crop the first scaled image, thereby generating a first corrected image to facilitate subsequent image recognition and comparison. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 It is a flow chart of the automatic optical detection method for a die-cutting machine in Example 1 of the present application.

[0055] Figure 2 It is a principle block diagram of the automatic optical detection system for the die-cutting machine in the second embodiment of the present application.

[0056] Figure 3 It is a schematic diagram of the equipment in Example 3 of the present application. DETAILED DESCRIPTION

[0057] The following is combined with Figures 1 to 3 This application is described in further detail. Embodiment 1

[0058] Reference Figure 1 The present application discloses an automatic optical detection method for a die-cutting machine, which specifically comprises the following steps:

[0059] S10: Determine the workpiece shape and position parameters, material model, and processing type of the current processing task, and set the image cropping area of ​​the current processing task based on the workpiece shape and position parameters to update the image cropping algorithm.

[0060] In this embodiment, a processing task refers to a production task of a workpiece stage finished product; the workpiece stage finished product refers to the finished product corresponding to the current processing task process; the workpiece shape and position parameters include the shape parameters, size parameters and position parameters of the workpiece stage finished product relative to the die-cutting machine processing surface.

[0061] Specifically, the workpiece shape and position parameters, raw material model, and processing type of the current die-cutting machine processing task are determined so as to subsequently determine the image cropping area and reduce the computer resource consumption for image recognition of invalid areas.

[0062] Wherein, in step S10, it includes:

[0063] S11: receiving processing setting information to set the processing program of the target die-cutting machine, and determining the workpiece shape and position parameters, raw material model, and processing type of the current processing task based on the processing setting information.

[0064] In this embodiment, processing setting information refers to information input by the operator of the die-cutting machine to the die-cutting machine for setting the die-cutting machine processing program to control the operation of the die-cutting machine, including workpiece shape and position parameters, raw material model, and processing type; raw material model refers to the model of the raw material required to correspond to the processing task, which may be specifically composed of characteristic information such as material, size, and appearance; processing type refers to the working mode of the die-cutting machine, including cutting, creasing, laminating, hot stamping, etc.

[0065] Specifically, the processing setting information is received to set the processing program of the target die-cutting machine, and the workpiece shape and position parameters, raw material model and processing type corresponding to the current processing task are determined according to the processing setting information, so as to facilitate the subsequent matching of the corresponding comparison images and quality judgment rules.

[0066] S12: determining the shape information, size information and position information relative to the cutting surface of the finished product of the workpiece stage of the current processing task based on the workpiece shape and position parameters, setting the image cropping area of ​​the current processing task to update the image cropping algorithm.

[0067] Specifically, the shape, size and position of the finished workpiece stage of the current processing task relative to the cutting surface are determined based on the workpiece shape and position parameters, and then the image cropping area of ​​the current processing task is set to update the image cropping algorithm, so as to facilitate the subsequent use of the image cropping algorithm to crop the images taken on the cutting surface and optimize the image comparison efficiency.

[0068] S20: Before the workpiece cutting begins, a first optical detection image of the cutting surface is obtained and input into a preset image preprocessing model, and correction and cropping are performed to generate a first corrected image.

[0069] In this embodiment, the die-cutting machine is provided with an imaging component for photographing the pressed and cut plate to obtain an optical detection image; the image preprocessing model has a built-in perspective correction algorithm and an image cropping algorithm for preprocessing the image photographed by the die-cutting machine imaging component.

[0070] Specifically, before the workpiece cutting begins, a first optical detection image of the cutting surface is acquired and input into an image preprocessing model so as to perform perspective correction and image cropping on the first optical detection image to obtain a first corrected image for subsequent image comparison.

[0071] Wherein, in step S20, it includes:

[0072] S21: When the raw material is delivered to the right place and before the workpiece cutting begins, a first optical detection image taken by the imaging component is acquired and input into the image preprocessing model.

[0073] Specifically, when the raw material is delivered to the desired position and before the workpiece cutting begins, a first optical detection image of the cutting surface captured by the imaging component is acquired and input into the image preprocessing model for subsequent preprocessing.

[0074] S22: Obtain the viewing angle information of the imaging component and the shooting orientation information of the lens axis relative to the cut surface and load them into the perspective correction algorithm, and use the perspective correction algorithm to scale the first optical detection image in different directions according to different scaling ratios to generate a first scaled image.

[0075] In this embodiment, the die-cutting surface refers to the plane on the die-cutting machine used to place raw materials, finished products and other sheet materials; the shooting orientation information specifically includes the imaging cone parameters of the imaging component, the relative position and relative direction parameters of the lens axis and the die-cutting surface; the first zoomed image refers to the image generated after the optical detection image is subjected to perspective correction processing.

[0076] Specifically, the viewing angle information and shooting orientation information of the imaging component are obtained and loaded into the perspective correction algorithm to determine the image deformation of the first optical detection image caused by the perspective principle. The first optical detection image is scaled in different directions at different scaling ratios through the perspective correction algorithm to generate a first scaled image, thereby reducing the image distortion caused by the perspective principle.

[0077] S23: identifying an image cropping region from the first zoomed image, and performing cropping processing on the first zoomed image based on the image cropping region to generate a first corrected image.

[0078] In this embodiment, the first corrected image refers to an image generated after performing image cropping processing on the first zoomed image.

[0079] Specifically, an image cropping region is identified from the first zoomed image to perform cropping processing on the first zoomed image, thereby generating a first corrected image to facilitate subsequent image recognition and comparison.

[0080] S30: based on the workpiece shape and position parameters, a stage finished product area image is intercepted from the first corrected image, the stage finished product area image is compared with the raw material reference image corresponding to the raw material model, and feeding specification information is generated. When the feeding specification information is qualified, a pressing and cutting start instruction is generated.

[0081] In this embodiment, the raw material reference image refers to the image obtained by photographing the qualified raw material on the die-cutting machine, which is used to subsequently determine whether the raw material supplied in the actual processing process is dirty, damaged, erroneous, etc.; the pressing and cutting start instruction refers to the instruction sent to the die-cutting machine to control the die-cutting machine to perform pressing and cutting.

[0082] Specifically, the finished product area image is captured from the first corrected image based on the workpiece shape and position parameters, and compared with the raw material reference image corresponding to the raw material model, so as to generate feeding specification information. When the feeding specification information is qualified, the pressing and cutting start instruction is generated, so as to suspend the operation of the die-cutting machine to troubleshoot the problem when the raw material is unqualified.

[0083] Wherein, in step S30, it includes:

[0084] S31: Based on the shape and position parameters of the workpiece, the stage finished product area is determined according to the boundary position of each stage finished product of the workpiece, and the stage finished product area image is intercepted from the first corrected image.

[0085] In this embodiment, the staged finished product area image completely covers the staged finished product pattern and the area where the staged finished product boundary is located.

[0086] Specifically, the boundary position of each stage product of the workpiece is determined based on the workpiece shape and position parameters, and then the area of ​​the stage product of the workpiece in the first corrected image is determined to intercept the stage product area image.

[0087] S32: Matching a corresponding raw material reference image from a preset comparison image library based on the raw material model.

[0088] In this embodiment, the comparison image library refers to a database for storing various reference images as standard images for image comparison.

[0089] Specifically, an image of a sheet material that meets the material model is matched from a preset comparison image library as a material reference image.

[0090] S33: Compare the stage finished product area image with the raw material reference image to determine whether there are abnormal image features in the stage finished product area image. If there are no abnormal image features, generate qualified feeding specification information and generate a pressing and cutting start instruction and send it to the die-cutting controller.

[0091] Specifically, the stage finished product area image is compared with the raw material reference image to determine whether there are abnormal image features in the stage finished product area image that are inconsistent with the raw material reference image. When no abnormal image features are found, it is considered that the image quality of the sheet raw material in the stage finished product area is qualified, so as to generate qualified feeding specification information, and generate a pressing and cutting start instruction and send it to the die-cutting controller to control the die-cutting machine to start die-cutting work.

[0092] S40: After the workpiece is pressed and cut, a second optical detection image is obtained, which is preprocessed to generate a second corrected image. The stage finished product pattern and the stage finished product boundary are intercepted from the second corrected image based on the workpiece shape and position parameters. The stage finished product pattern and the stage finished product boundary are compared with the finished product reference image and the boundary reference image corresponding to the processing type to generate finished product specification information.

[0093] In this embodiment, the second optical detection image and the second corrected image are acquired in the same manner as the first optical detection image and the first corrected image.

[0094] Specifically, after the workpiece is press-cut, a second optical inspection image of the press-cut surface is obtained and input into a preset image preprocessing model for perspective correction, image cropping and other preprocessing to obtain a second corrected image. The stage finished product pattern and stage finished product boundary are intercepted from the second corrected image according to the workpiece shape and position parameters, and compared with the corresponding finished product reference image and boundary reference image to generate finished product specification information for judging whether the finished product quality is qualified, thereby improving the timeliness of die-cutting quality problem detection.

[0095] Wherein, in step S40, it includes:

[0096] S41: Based on the shape and position parameters of the workpiece, determine the area where the staged product and the die-cutting boundary of the workpiece are located in the second corrected image, so as to intercept the image of the corresponding area from the second corrected image to obtain the staged product pattern and the staged product boundary.

[0097] Specifically, based on the workpiece shape and position parameters, the areas where the workpiece stage finished product and the die-cutting boundary are located in the second corrected image are determined, so as to intercept the stage finished product pattern according to the area where the workpiece stage finished product is located in the second corrected image, and intercept the stage finished product boundary according to the area where the die-cutting boundary is located.

[0098] S42: Based on the known raw material model and processing type, the corresponding finished product reference image and boundary reference image are matched from a preset comparison image library.

[0099] In this embodiment, the finished product reference image and the boundary reference image may be specifically obtained by capturing an image of a successfully produced finished product at the workpiece stage.

[0100] Specifically, based on the known raw material model and processing type, the workpiece stage finished product image and the die-cutting boundary image of the successful sample die-cutting under the same working conditions are matched from the comparison image library as the finished product reference image and the boundary reference image.

[0101] S43: Compare the stage finished product pattern with the finished product reference image, and compare the stage finished product boundary with the boundary reference image. If there are no abnormal image features in both, generate qualified finished product specification information.

[0102] Specifically, the stage finished product pattern is compared with the finished product reference image, and the stage finished product boundary is compared with the boundary reference image to determine whether the quality of the finished product of this die-cutting work is qualified. If no abnormal image features appear during the comparison of the two images, qualified finished product specification information is generated, which makes it easy to know whether the current workpiece stage finished product processing quality is qualified.

[0103] It should be understood that the serial numbers of the steps in the above embodiments do not imply a sequence of execution. The execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. Embodiment 2

[0104] An automatic optical detection system for a die-cutting machine corresponds to the automatic optical detection method for a die-cutting machine in the above embodiment.

[0105] like Figure 2 As shown, the automatic optical inspection system for die-cutting machine includes an image cropping algorithm update module, a first correction image generation module, a pressing and cutting start instruction generation module and a finished product specification information generation module. The detailed description of each functional module is as follows:

[0106] An image cropping algorithm update module is used to determine the workpiece shape and position parameters, raw material model, and processing type of the current processing task, and to set the image cropping area of ​​the current processing task based on the workpiece shape and position parameters to update the image cropping algorithm;

[0107] A first corrected image generation module is used to obtain a first optical detection image of the pressing and cutting surface before the workpiece pressing and cutting begins, and input it into a preset image preprocessing model to perform correction and cropping processing to generate a first corrected image;

[0108] A pressing and cutting start instruction generating module is used to intercept a stage finished product area image from the first corrected image based on the workpiece shape and position parameters, compare the stage finished product area image with a raw material reference image corresponding to the raw material model, generate feed specification information, and generate a pressing and cutting start instruction when the feed specification information is qualified;

[0109] The module for generating finished product specification information is used to obtain a second optical detection image after the workpiece is pressed and cut, generate a second corrected image through preprocessing, extract the stage finished product pattern and stage finished product boundary from the second corrected image based on the workpiece shape and position parameters, compare the stage finished product pattern and stage finished product boundary with the finished product reference image and boundary reference image corresponding to the processing type, and generate finished product specification information.

[0110] Among them, the image cropping algorithm update module also includes:

[0111] The processing task analysis submodule is used to receive processing setting information to set the processing program of the target die-cutting machine, and determine the workpiece shape and position parameters, raw material model, and processing type of the current processing task based on the processing setting information;

[0112] The image cropping area setting submodule is used to determine the shape information, size information and position information relative to the cutting surface of the workpiece stage finished product of the current processing task based on the workpiece shape and position parameters, set the image cropping area of ​​the current processing task, and update the image cropping algorithm.

[0113] Wherein, the first corrected image generation module further includes:

[0114] A first optical detection image acquisition submodule is used to acquire a first optical detection image taken by the imaging component and input it into an image preprocessing model when the raw material is delivered to the site and before the workpiece pressing and cutting begins;

[0115] A first zoomed image generation submodule is used to obtain the viewing angle information of the imaging component and the shooting orientation information of the lens axis relative to the pressing and cutting surface and load them into the perspective correction algorithm, and to perform zooming processing on the first optical detection image in different directions according to different zooming ratios through the perspective correction algorithm to generate a first zoomed image;

[0116] The scaled image cropping processing submodule is used to identify an image cropping area from the first scaled image, perform cropping processing on the first scaled image based on the image cropping area, and generate a first corrected image.

[0117] The pressure cutting start instruction generation module also includes:

[0118] The submodule for capturing the image of the stage finished product area is used to determine the stage finished product area according to the boundary position of each stage finished product of each workpiece based on the shape and position parameters of the workpiece, and to capture the image of the stage finished product area from the first corrected image;

[0119] A raw material reference image matching submodule, used to match the corresponding raw material reference image from a preset comparison image library based on the raw material model;

[0120] The feed specification information generation submodule is used to compare the stage finished product area image with the raw material reference image to determine whether there are abnormal image features in the stage finished product area image. If there are no abnormal image features, qualified feed specification information is generated, and a pressing and cutting start instruction is generated and sent to the die-cutting controller.

[0121] Among them, the finished product specification information generation module also includes:

[0122] The second corrected image processing submodule is used to determine the area where the staged product and the die-cutting boundary of the workpiece are located in the second corrected image based on the shape and position parameters of the workpiece, so as to intercept the image of the corresponding area from the second corrected image to obtain the staged product pattern and the staged product boundary;

[0123] A finished product reference image matching submodule is used to match the corresponding finished product reference image and boundary reference image from a preset comparison image library based on the known raw material model and processing type;

[0124] The finished product image comparison submodule is used to compare the stage finished product pattern with the finished product reference image, and the stage finished product boundary with the boundary reference image. If there are no abnormal image features in both, qualified finished product specification information is generated.

[0125] For the specific limitations on the automatic optical inspection system for die-cutting machines, please refer to the limitations on the automatic optical inspection method for die-cutting machines in the above text, which will not be repeated here; the various modules in the above-mentioned automatic optical inspection system for die-cutting machines can be fully or partially implemented by software, hardware and their combination; the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the corresponding operations of the above-mentioned modules. Embodiment 3

[0126] A computer device, which may be a server, may have an internal structure as shown in Figure 3 As shown. The computer device includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data such as workpiece shape and position parameters, raw material model, processing type, image clipping algorithm, first optical detection image, image preprocessing model, first correction image, stage finished product area image, raw material reference image, feeding specification information, pressing and cutting start instructions, second optical detection image, second correction image, stage finished product pattern, stage finished product boundary, finished product reference image, boundary reference image and finished product specification information. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, an automatic optical detection method for a die-cutting machine is implemented.

[0127] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program:

[0128] S10: determining the workpiece shape and position parameters, raw material model, and processing type of the current processing task, and setting the image cropping area of ​​the current processing task based on the workpiece shape and position parameters to update the image cropping algorithm;

[0129] S20: before the workpiece cutting starts, a first optical detection image of the cutting surface is obtained and input into a preset image preprocessing model, and correction and cropping are performed to generate a first corrected image;

[0130] S30: intercepting a stage finished product area image from the first corrected image based on the workpiece shape and position parameters, comparing the stage finished product area image with a raw material reference image corresponding to the raw material model, generating feed specification information, and generating a press-cut start instruction when the feed specification information is qualified;

[0131] S40: After the workpiece is pressed and cut, a second optical detection image is obtained, which is preprocessed to generate a second corrected image. The stage finished product pattern and the stage finished product boundary are intercepted from the second corrected image based on the workpiece shape and position parameters. The stage finished product pattern and the stage finished product boundary are compared with the finished product reference image and the boundary reference image corresponding to the processing type to generate finished product specification information.

[0132] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0133] S10: determining the workpiece shape and position parameters, raw material model, and processing type of the current processing task, and setting the image cropping area of ​​the current processing task based on the workpiece shape and position parameters to update the image cropping algorithm;

[0134] S20: before the workpiece cutting starts, a first optical detection image of the cutting surface is obtained and input into a preset image preprocessing model, and correction and cropping are performed to generate a first corrected image;

[0135] S30: intercepting a stage finished product area image from the first corrected image based on the workpiece shape and position parameters, comparing the stage finished product area image with a raw material reference image corresponding to the raw material model, generating feed specification information, and generating a press-cut start instruction when the feed specification information is qualified;

[0136] S40: After the workpiece is pressed and cut, a second optical detection image is obtained, which is preprocessed to generate a second corrected image. The stage finished product pattern and the stage finished product boundary are intercepted from the second corrected image based on the workpiece shape and position parameters. The stage finished product pattern and the stage finished product boundary are compared with the finished product reference image and the boundary reference image corresponding to the processing type to generate finished product specification information.

[0137] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink), DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0138] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0139] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments may still be modified, or some of the features thereof may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. An automatic optical detection method for a die-cutting machine, characterized in that: include: Determine the workpiece shape and position parameters, raw material model, and processing type of the current processing task, and set the image cropping area of ​​the current processing task based on the workpiece shape and position parameters to update the image cropping algorithm; Before the workpiece cutting begins, a first optical detection image of the cutting surface is obtained and input into a preset image preprocessing model, and correction and cropping are performed to generate a first corrected image; Based on the workpiece shape and position parameters, a stage finished product area image is intercepted from the first corrected image, the stage finished product area image is compared with a raw material reference image corresponding to the raw material model, and feeding specification information is generated, and when the feeding specification information is qualified, a pressing and cutting start instruction is generated; After the workpiece is pressed and cut, a second optical detection image is obtained, and a second corrected image is generated after preprocessing. A stage finished product pattern and a stage finished product boundary are intercepted from the second corrected image based on the workpiece shape and position parameters, and the stage finished product pattern and the stage finished product boundary are compared with the finished product reference image and the boundary reference image corresponding to the processing type to generate finished product specification information; The die-cutting machine is provided with an imaging component for photographing the pressed and cut plate to obtain an optical detection image; the image preprocessing model is built with a perspective correction algorithm and an image cropping algorithm; The step of determining the workpiece shape and position parameters, material model, and processing type of the current processing task, and setting the image cropping area of ​​the current processing task based on the workpiece shape and position parameters to update the image cropping algorithm includes: Receive processing setting information to set the processing program of the target die-cutting machine, and determine the workpiece shape and position parameters, raw material model, and processing type of the current processing task based on the processing setting information; The shape information, size information and position information relative to the cutting surface of the finished product of the workpiece stage of the current processing task are determined based on the workpiece shape and position parameters, and the image cropping area of ​​the current processing task is set to update the image cropping algorithm.

2. The automatic optical detection method for a die-cutting machine according to claim 1, characterized in that: Before the workpiece cutting begins, a first optical detection image of the cutting surface is obtained and input into a preset image preprocessing model, and correction and cropping are performed to generate a first corrected image, including: When the raw material is delivered to the place and before the workpiece cutting begins, a first optical detection image taken by the imaging component is acquired and input into the image preprocessing model; Obtaining the viewing angle information of the imaging component and the shooting orientation information of the lens axis relative to the pressed-cutting layout and loading them into the perspective correction algorithm, scaling the first optical detection image in different directions according to different scaling ratios through the perspective correction algorithm to generate a first scaled image; An image cropping region is identified from the first zoomed image, and the first zoomed image is cropped based on the image cropping region to generate a first corrected image.

3. The automatic optical detection method for a die-cutting machine according to claim 1, characterized in that: The method includes intercepting a stage finished product area image from the first corrected image based on the workpiece shape and position parameters, comparing the stage finished product area image with a raw material reference image corresponding to the raw material model, generating feed specification information, and generating a press-cut start instruction when the feed specification information is qualified, including: Based on the shape and position parameters of the workpiece, the stage finished product area is determined according to the boundary position of the stage finished product of each workpiece, and the stage finished product area image is intercepted from the first corrected image; Matching the corresponding raw material reference image from a preset comparison image library based on the raw material model; The stage finished product area image is compared with the raw material reference image to determine whether there are abnormal image features in the stage finished product area image. If there are no abnormal image features, qualified feeding specification information is generated, and a pressing and cutting start instruction is generated and sent to the die-cutting controller; the stage finished product area image completely covers the stage finished product pattern and the area where the stage finished product boundary is located.

4. The automatic optical detection method for a die-cutting machine according to claim 1, characterized in that: The method of intercepting a stage finished product pattern and a stage finished product boundary from the second corrected image based on the workpiece shape and position parameters, comparing the stage finished product pattern and the stage finished product boundary with the finished product reference image and the boundary reference image corresponding to the processing type, and generating finished product specification information includes: Based on the shape and position parameters of the workpiece, the area where the staged product and the die-cutting boundary of the workpiece are located in the second corrected image is determined, so as to intercept the image of the corresponding area from the second corrected image to obtain the staged product pattern and the staged product boundary; Based on the known raw material model and processing type, the corresponding finished product reference image and boundary reference image are matched from the preset comparison image library; The stage finished product pattern is compared with the finished product reference image, and the stage finished product boundary is compared with the boundary reference image. If there are no abnormal image features in both, qualified finished product specification information is generated.

5. Automatic optical inspection system for die-cutting machine, characterized in that: The automatic optical detection method for a die-cutting machine as claimed in any one of claims 1 to 4 comprises: An image cropping algorithm update module is used to determine the workpiece shape and position parameters, raw material model, and processing type of the current processing task, and to set the image cropping area of ​​the current processing task based on the workpiece shape and position parameters to update the image cropping algorithm; A first corrected image generation module is used to obtain a first optical detection image of the pressing and cutting surface before the workpiece pressing and cutting begins, and input it into a preset image preprocessing model to perform correction and cropping processing to generate a first corrected image; A pressing and cutting start instruction generating module is used to intercept a stage finished product area image from the first corrected image based on the workpiece shape and position parameters, compare the stage finished product area image with a raw material reference image corresponding to the raw material model, generate feed specification information, and generate a pressing and cutting start instruction when the feed specification information is qualified; The finished product specification information generating module is used to obtain the second optical detection image after the workpiece is pressed and cut, generate the second corrected image through preprocessing, intercept the stage finished product pattern and the stage finished product boundary from the second corrected image based on the workpiece shape and position parameters, compare the stage finished product pattern and the stage finished product boundary with the finished product reference image and the boundary reference image corresponding to the processing type, and generate the finished product specification information; The die-cutting machine is provided with an imaging component for photographing the pressed and cut plate to obtain an optical detection image; the image preprocessing model is built with a perspective correction algorithm and an image cropping algorithm; Wherein, the image cropping algorithm update module includes: The processing task analysis submodule is used to receive processing setting information to set the processing program of the target die-cutting machine, and determine the workpiece shape and position parameters, raw material model, and processing type of the current processing task based on the processing setting information; The image cropping area setting submodule is used to determine the shape information, size information and position information relative to the cutting surface of the workpiece stage finished product of the current processing task based on the workpiece shape and position parameters, set the image cropping area of ​​the current processing task, and update the image cropping algorithm.

6. The automatic optical inspection system for a die-cutting machine according to claim 5, characterized in that: The first corrected image generation module comprises: A first optical detection image acquisition submodule is used to acquire a first optical detection image taken by the imaging component and input it into an image preprocessing model when the raw material is delivered to the site and before the workpiece pressing and cutting begins; A first zoomed image generation submodule is used to obtain the viewing angle information of the imaging component and the shooting orientation information of the lens axis relative to the pressing and cutting surface and load them into the perspective correction algorithm, and to perform zooming processing on the first optical detection image in different directions according to different zooming ratios through the perspective correction algorithm to generate a first zoomed image; The scaled image cropping processing submodule is used to identify an image cropping area from the first scaled image, perform cropping processing on the first scaled image based on the image cropping area, and generate a first corrected image.

7. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the automatic optical inspection method for a die-cutting machine according to any one of claims 1 to 4 are implemented.

8. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the automatic optical inspection method for a die-cutting machine according to any one of claims 1 to 4 are implemented.

Images