Industrial automation control system and method based on industrial vision

Abstract

The invention provides an industrial automation control system and method based on industrial vision, and relates to the technical field of industrial control. Performing phase shift extraction on the infrared light interference image set to obtain an interference phase shift field, and performing surface recovery on the assembly line product according to the interference phase shift field and the infrared light interference parameters to obtain object plane phase information; interference phase information is obtained, an interference reset image is obtained through the interference phase information and the object plane phase information, the interference reset image is compared with a given standard image, and the deformation quantity of the assembly line product is obtained; a deformation feedback signal of the production workshop assembly line is generated through the deformation quantity of the assembly line product, and the programmable logic controller controls operation of industrial equipment on the production workshop assembly line according to the deformation feedback signal. And a feedback control signal of the industrial control system is generated based on the accurate deformation quantity, so that the robustness of the industrial control system is improved.

Description

Technical Field

[0001] The present application relates to the field of industrial control technology, and more specifically, to an industrial automation control system and method based on industrial vision. Background Art

[0002] Industrial automation control based on industrial vision is an advanced method that uses image processing and computer vision technology to monitor and intelligently analyze equipment, products, and the environment in the production process in real time. The system uses high-precision cameras and sensors to capture image data on the production line, and combines deep learning and image recognition algorithms to monitor and optimize product quality, equipment status, and production efficiency. The core of this automated control system is to convert the acquired visual information into actionable control instructions, thereby achieving automatic adjustment of equipment and fault warning, thereby improving the intelligence level and flexible manufacturing capabilities of the production line.

[0003] In industrial automation control based on industrial vision, high-precision optical equipment can be used to detect the deformation and damage of products on the production line in the production workshop. In the prior art, however, in the industrial production environment, factors such as lighting conditions, dust, smoke, and motion blur may affect the clarity and accuracy of the optical image, and the deformation detection of the assembly line products is usually carried out by the reflection image comparison method, but the direct reflection image will cause the deformation detection of the assembly line products to be inaccurate due to the insufficient reflectivity. Therefore, how to improve the accuracy of deformation detection of assembly line products and generate feedback control signals for industrial control systems based on accurate deformation quantities to improve the robustness of industrial control systems is a difficult problem faced by the industry. Summary of the invention

[0004] The present application provides an industrial automation control system and method based on industrial vision, which can improve the accuracy of deformation detection of assembly line products and generate feedback control signals of the industrial control system based on precise deformation amounts to improve the robustness of the industrial control system.

[0005] In a first aspect, the present application provides an industrial automation control method based on industrial vision, the control method comprising the following steps:

[0006] Collect infrared interference image sets of products on the production line;

[0007] Performing phase shift extraction on the infrared light interference image set to obtain an interference phase shift field of the pipeline product under infrared light interference, and performing surface restoration on the pipeline product according to the interference phase shift field and infrared light interference parameters to obtain object surface phase information of the pipeline product;

[0008] Acquire the interference phase information of the pipeline product, obtain the interference reconstructed image of the pipeline product through the interference phase information and the object plane phase information, and compare the interference reconstructed image with a given standard image to obtain the deformation amount of the pipeline product;

[0009] A deformation feedback signal of the production workshop assembly line is generated by the deformation amount of the assembly line product, and a programmable logic controller controls the operation of industrial equipment on the production workshop assembly line according to the deformation feedback signal.

[0010] In this embodiment, an infrared light interferometer is used to collect an infrared light interference image set of products on the production line of the production workshop.

[0011] In this embodiment, performing phase shift extraction on the infrared light interference image set to obtain the interference phase shift field of the assembly line product under infrared light interference specifically includes:

[0012] For each infrared light interference image in the infrared light interference image set, sliding filtering is performed on the infrared light interference image to obtain a filtered infrared light interference image;

[0013] Performing phase shift extraction on the filtered infrared light interference image to obtain a phase shift value corresponding to the infrared light interference image, and further obtaining a phase shift value corresponding to each infrared light interference image in the infrared light interference image set;

[0014] The interference phase shift field of the production line products under infrared light interference is determined according to all the phase shift values.

[0015] In this embodiment, performing sliding filtering on the infrared light interference image to obtain the filtered infrared light interference image specifically includes:

[0016] Set the pixel sliding domain;

[0017] For each pixel point in the infrared light interference image, determining a brightness coefficient and a texture complexity of the pixel point according to the pixel sliding domain;

[0018] The pixel points are filtered by using the brightness coefficient and the texture complexity to obtain filtered pixel points, and then a filtered infrared light interference image is obtained.

[0019] In this embodiment, performing surface restoration on the pipeline product according to the interference phase shift field and the infrared light interference parameter to obtain the object surface phase information of the pipeline product specifically includes:

[0020] Determine all reset phase shift values ​​in the interference reset process of the assembly line product through the interference phase shift field and the interference distance in the infrared light interference parameter;

[0021] The object plane phase information of the pipeline product is determined by all the reset phase shift values ​​and the infrared light wavelength in the infrared light interference parameters.

[0022] In this embodiment, obtaining the interference phase information of the assembly line product specifically includes:

[0023] Performing phase recovery on each infrared light interference image in the infrared light interference image set to obtain an interference phase value of each infrared light interference image;

[0024] The set of all interference phase values ​​is used as the interference phase information of the pipeline product.

[0025] In this embodiment, obtaining the interference resetting image of the assembly line product through the interference phase information and the object plane phase information specifically includes:

[0026] generating a reset image of the pipeline product according to the interference phase information;

[0027] The object plane phase information is used to perform phase compensation on the reconstructed image, thereby obtaining an interference reconstructed image of the assembly line product.

[0028] In this embodiment, the interference reset image is compared with a given standard image to obtain the deformation amount of the assembly line product, which specifically includes:

[0029] Respectively extracting the phase value of the interference restoration image and the phase value of the standard image;

[0030] Comparing the phase value of the interference restoration image with the phase value of the standard image to obtain a phase difference;

[0031] The ratio of the phase difference to the wavelength constant is taken as the deformation amount of the assembly line product.

[0032] In this embodiment, generating the deformation feedback signal of the production workshop assembly line according to the deformation amount of the assembly line product specifically includes:

[0033] Converting the deformation amount of the assembly line product into a digital signal;

[0034] The digital signal is used as a deformation feedback signal of the production workshop assembly line.

[0035] In a second aspect, the present application provides an industrial automation control system based on industrial vision, which is used to execute an industrial automation control method based on industrial vision, and the control system includes:

[0036] Image acquisition module, used to collect infrared interference image sets of products on the production line;

[0037] An information extraction module is used to perform phase shift extraction on the infrared light interference image set to obtain the interference phase shift field of the pipeline product under infrared light interference, and perform surface restoration on the pipeline product according to the interference phase shift field and infrared light interference parameters to obtain the object surface phase information of the pipeline product;

[0038] A deformation amount determination module is used to obtain the interference phase information of the pipeline product, obtain the interference resetting image of the pipeline product through the interference phase information and the object plane phase information, and compare the interference resetting image with a given standard image to obtain the deformation amount of the pipeline product;

[0039] The feedback control module is used to generate a deformation feedback signal of the production workshop assembly line according to the deformation amount of the assembly line product, and the programmable logic controller controls the operation of the industrial equipment on the production workshop assembly line according to the deformation feedback signal.

[0040] The technical solution provided by the embodiments disclosed in this application has the following beneficial effects:

[0041] By collecting an infrared light interference image set of products on an assembly line in a production workshop; performing phase shift extraction on the infrared light interference image set to obtain an interference phase shift field of the assembly line products under infrared light interference, performing surface restoration on the assembly line products according to the interference phase shift field and infrared light interference parameters to obtain object surface phase information of the assembly line products; obtaining the interference phase information of the assembly line products, obtaining an interference reset image of the assembly line products through the interference phase information and the object surface phase information, using the interference reset image to compare with a given standard image to obtain the deformation amount of the assembly line products; generating a deformation feedback signal of the assembly line in the production workshop through the deformation amount of the assembly line products, and a programmable logic controller controls the operation of industrial equipment on the assembly line in the production workshop according to the deformation feedback signal.

[0042] It can be seen that in the present application, the accuracy of deformation detection of assembly line products can be improved, and feedback control signals of industrial control systems can be generated based on precise deformation quantities; wherein, infrared light interference technology can detect tiny surface deformations and provide high-resolution phase information. Through phase shift extraction, continuous phase changes can be obtained, and then precise deformation quantities can be calculated. Moreover, through filtering technology, the influence of noise on data can be effectively reduced, thereby improving the signal-to-noise ratio of deformation detection; then, by utilizing interference phase information, a more comprehensive product surface state can be provided, and by comparing the interference reset image with the standard image, the product deformation can be more accurately quantified based on the phase difference, and the deviation from the standard state can be identified. Accurate deformation monitoring can improve the system's sensitivity to environmental changes and equipment failures, thereby improving the stability of the overall industrial control system; finally, the deformation feedback signal enables the production line to adjust the equipment operating parameters in real time according to the product deformation, thereby optimizing the production speed and process, and the programmable logic controller can quickly respond to the deformation feedback signal. Real-time deformation feedback can help identify potential problems and improve the robustness and stability of the industrial control system.

[0043] In summary, the technical solution adopted in this application can improve the accuracy of deformation detection of assembly line products, and generate feedback control signals of industrial control systems based on precise deformation quantities to improve the robustness of industrial control systems. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0045] Figure 1 is a flow chart of an industrial automation control method based on industrial vision provided by the present application;

[0046] Figure 2 is an exemplary flow chart for determining an interferometric phase shift field according to the present application;

[0047] Figure 3 is an exemplary flow chart for determining an interference reset image provided by the present application;

[0048] Figure 4 This is a module structure diagram of an industrial automation control system based on industrial vision provided in this application. DETAILED DESCRIPTION

[0049] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0050] The embodiment of the present application provides an industrial automation control system and method based on industrial vision, the core of which is to collect infrared light interference image sets of products on the production workshop assembly line; extract the phase shift of the infrared light interference image sets to obtain the interference phase shift field of the assembly line products under infrared light interference, and restore the surface of the assembly line products according to the interference phase shift field and infrared light interference parameters to obtain the object surface phase information of the assembly line products; obtain the interference phase information of the assembly line products, obtain the interference reset image of the assembly line products through the interference phase information and the object surface phase information, and use the interference reset image and a given standard image for comparison to obtain the deformation of the assembly line products; generate the deformation feedback signal of the assembly line of the production workshop through the deformation of the assembly line products, and the programmable logic controller controls the operation of the industrial equipment on the assembly line of the production workshop according to the deformation feedback signal. The above scheme can improve the accuracy of deformation detection of assembly line products, and generate feedback control signals of industrial control systems based on accurate deformation, so as to improve the robustness of industrial control systems.

[0051] Embodiment 1

[0052] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods. Figure 1 As shown, this figure is an exemplary flow chart of an industrial automation control method based on industrial vision according to this embodiment of the present application, and the control method includes the following steps:

[0053] In step S1, a set of infrared interference images of products on an assembly line in a production workshop is collected.

[0054] In specific implementation, an infrared light interferometer is used to collect an infrared light interference image set of products on the assembly line of a production workshop. The light source wavelength of the infrared light interferometer can be adjusted according to the required measurement accuracy and the material properties of the assembly line products, and a suitable interference mode can be selected as needed to obtain the best image quality. The infrared light interferometer and the image acquisition system are started to capture the interference image of the product in real time during the operation of the assembly line. Multiple frames of images are collected for the same assembly line products to form a time series image set, that is, the infrared light interference image set of products on the assembly line of the production workshop.

[0055] In step S2, phase shift extraction is performed on the infrared light interference image set to obtain the interference phase shift field of the pipeline product under infrared light interference, and the surface of the pipeline product is restored according to the interference phase shift field and infrared light interference parameters to obtain the object surface phase information of the pipeline product.

[0056] Preferably, in this embodiment, reference Figure 2 As shown in FIG. 1 , this figure is an exemplary flow chart for determining the interference phase shift field in an embodiment of the present application. In this embodiment, the phase shift extraction of the infrared light interference image set is performed to obtain the interference phase shift field of the assembly line product under infrared light interference, which can be specifically implemented by the following steps:

[0057] First, in step S21, for each infrared light interference image in the infrared light interference image set, sliding filtering is performed on the infrared light interference image to obtain a filtered infrared light interference image;

[0058] Then, in step S22, phase shift extraction is performed on the filtered infrared light interference image to obtain a phase shift value corresponding to the infrared light interference image, and then a phase shift value corresponding to each infrared light interference image in the infrared light interference image set is obtained;

[0059] Finally, in step S23, the interference phase shift field of the pipeline product under infrared light interference is determined according to all phase shift values.

[0060] In a specific implementation, first, for each infrared light interference image in the infrared light interference image set, a sliding filter is performed on the infrared light interference image to obtain a filtered infrared light interference image; then, a phase shift extraction is performed on the filtered infrared light interference image, and an existing phase shift extraction algorithm (for example, a Fourier transform method or a spatial phase shift method) can be used to perform phase shift extraction on the filtered infrared light interference image to obtain a phase shift value of each pixel point in the filtered infrared light interference image, and the phase shift value represents the phase offset of the pixel position in the filtered infrared light interference image, so that The average of the phase shift values ​​of all pixel points is taken as the phase shift value corresponding to the infrared light interference image, and the phase shift value represents the phase offset of the overall pixel position in the infrared light interference image. The phase shift value corresponding to each infrared light interference image in the infrared light interference image set can be obtained in the above manner; finally, the interference phase shift field of the assembly line product under infrared light interference can be determined according to all the phase shift values, that is, the data set composed of all the phase shift values ​​is collected as the interference phase shift field of the assembly line product under infrared light interference, and the interference phase shift field represents the phase change information caused by the surface deformation of the assembly line product under infrared light interference.

[0061] In this embodiment, the infrared light interference image is subjected to sliding filtering to obtain the filtered infrared light interference image in the following manner, namely:

[0062] Set the pixel sliding domain;

[0063] For each pixel point in the infrared light interference image, determining a brightness coefficient and a texture complexity of the pixel point according to the pixel sliding domain;

[0064] The pixel points are filtered by using the brightness coefficient and the texture complexity to obtain filtered pixel points, and then a filtered infrared light interference image is obtained.

[0065] In specific implementation, first, a pixel sliding domain can be set according to historical experiments and data analysis, and the pixel sliding domain is a sliding window; then, for each pixel point in the infrared light interference image, the pixel point is selected as the center of the pixel sliding domain, so as to count all the pixel points contained in the pixel sliding domain at this time, and the ratio of the sum of the pixel values ​​of all the pixel points to the number of the pixel points can be used as the brightness coefficient corresponding to the selected pixel point, and the brightness coefficient is used to measure the brightness level of all the pixel points centered on the selected pixel point, and the average value of the square of the deviation between the sum of the pixel values ​​of all the pixel points and the pixel mean can be used as the texture complexity corresponding to the selected pixel point, and the texture complexity represents the complexity of the image texture of all the pixel points centered on the selected pixel point; finally, the ratio of the brightness coefficient corresponding to the pixel point and the texture complexity can be used as the weight of the pixel point, and the pixel point is filtered based on the weight to obtain the filtered pixel point, and the filtered infrared light interference image can be obtained in the above manner.

[0066] In this embodiment, the surface of the pipeline product is restored according to the interference phase shift field and the infrared light interference parameter to obtain the object surface phase information of the pipeline product in the following manner, namely:

[0067] Determine all reset phase shift values ​​in the interference reset process of the assembly line product through the interference phase shift field and the interference distance in the infrared light interference parameter;

[0068] The object plane phase information of the pipeline product is determined by all the reset phase shift values ​​and the infrared light wavelength in the infrared light interference parameters.

[0069] It should be noted that in the present application, the infrared light interference parameters include the interference distance and the infrared light wavelength. The wavelength of the infrared light can be obtained from the specification sheet of the light source or experimental measurement, usually in nanometers (nm). The interference distance represents the distance between the reference surface of the infrared light interferometer and the assembly line surface, which can be set according to the experiment.

[0070] In specific implementation, first, all reset phase shift values ​​in the interference reset process of the pipeline product can be determined by the interference phase shift field and the interference distance in the infrared light interference parameter, that is, the ratio of the phase shift value in the interference phase shift field to the interference distance in the infrared light interference parameter is used as the reset phase shift value in the interference reset process of the pipeline product, and the reset phase shift value represents the phase shift value obtained by the interference reset. All reset phase shift values ​​in the interference reset process of the pipeline product can be obtained in the above manner; then, the object surface phase information of the pipeline product can be determined by all the reset phase shift values ​​and the infrared light wavelength in the infrared light interference parameter, that is, the ratio of each reset phase shift value multiplied by twice the pi to the infrared light wavelength is used as the corresponding object surface phase, and the object surface phase is a complex expression of the amplitude and phase of the infrared light wave at a specific position, and the data composed of all object surface phases are combined as the object surface phase information of the pipeline product, and the object surface phase information represents the amplitude information (i.e., light intensity) and phase information of the light wave on the surface of the pipeline product.

[0071] It should be noted that infrared light interferometry technology can detect tiny surface deformations and provide high-resolution phase information. Through phase shift extraction, continuous phase changes can be obtained, and then the precise deformation amount can be calculated. Moreover, through filtering technology, the impact of noise on the data can be effectively reduced, thereby improving the signal-to-noise ratio of deformation detection.

[0072] In step S3, the interference phase information of the pipeline product is obtained, and the interference reconstruction image of the pipeline product is obtained through the interference phase information and the object plane phase information. The interference reconstruction image is compared with a given standard image to obtain the deformation amount of the pipeline product.

[0073] In this embodiment, the interference phase information of the pipeline product may be obtained in the following manner:

[0074] Performing phase recovery on each infrared light interference image in the infrared light interference image set to obtain an interference phase value of each infrared light interference image;

[0075] The set of all interference phase values ​​is used as the interference phase information of the pipeline product.

[0076] In specific implementation, phase recovery is performed on each infrared light interference image in the infrared light interference image set, that is, an existing phase recovery algorithm (for example, Fienup algorithm) can be used to perform phase recovery on each infrared light interference image, so that the interference phase value of each infrared light interference image can be obtained, and the set of all interference phase values ​​can be used as the interference phase information of the assembly line product.

[0077] Preferably, in this embodiment, reference Figure 3As shown in FIG. 1 , this figure is an exemplary flow chart of determining the interference resetting image in an embodiment of the present application. In this embodiment, obtaining the interference resetting image of the pipeline product through the interference phase information and the object plane phase information can be specifically implemented by the following steps:

[0078] First, in step S31, a reset image of the pipeline product is generated according to the interference phase information;

[0079] Then, in step S32, the object plane phase information is used to perform phase compensation on the reconstructed image, thereby obtaining an interference reconstructed image of the assembly line product.

[0080] In specific implementation, first, a reset image of the assembly line product can be generated based on the interference phase information, that is, the interference phase information is converted into corresponding image data, which can be achieved by combining the phase map with the amplitude information. For example, the phase information is mapped to the image space using the Fourier transform and other techniques, thereby obtaining a reset image of the assembly line product; then, the object plane phase information can be used to perform phase compensation on the reset image, that is, adjust the phase value of each pixel in the reset image, which can be achieved through the existing phase compensation algorithm, thereby correcting the phase error caused by the surface shape or optical characteristics of the product.

[0081] In this embodiment, the interference reset image is compared with a given standard image to obtain the deformation amount of the assembly line product in the following manner, namely:

[0082] Respectively extracting the phase value of the interference restoration image and the phase value of the standard image;

[0083] Comparing the phase value of the interference restoration image with the phase value of the standard image to obtain a phase difference;

[0084] The ratio of the phase difference to the wavelength constant is taken as the deformation amount of the assembly line product.

[0085] In specific implementation, first, a predetermined standard image is obtained, and the phase value of the interference reset image and the phase value of the standard image can be obtained through image processing technology; then, the extracted interference reset image phase value can be compared with the standard image phase value pixel by pixel to calculate the phase difference; finally, a wavelength constant for calculation can be set according to the experiment, and the ratio of the phase difference to the wavelength constant can be used as the deformation amount of the assembly line product, and the deformation amount represents the degree of deformation of the assembly line product on the assembly line in the production workshop.

[0086] It should be noted that by utilizing the interference phase information, a more comprehensive product surface status can be provided, and by comparing the interference reset image with the standard image, the product deformation can be quantified more accurately based on the phase difference, and the deviation from the standard state can be identified. Accurate deformation monitoring can improve the system's sensitivity to environmental changes and equipment failures, thereby improving the stability of the overall system.

[0087] In step S4, a deformation feedback signal of the production workshop assembly line is generated according to the deformation amount of the assembly line product, and a programmable logic controller controls the operation of industrial equipment on the production workshop assembly line according to the deformation feedback signal.

[0088] In this embodiment, the deformation feedback signal of the production workshop assembly line is generated by the deformation amount of the assembly line product in the following manner, namely:

[0089] Converting the deformation amount of the assembly line product into a digital signal;

[0090] The digital signal is used as a deformation feedback signal of the production workshop assembly line.

[0091] In specific implementation, the deformation amount of the assembly line product is converted into a digital signal, which can be converted through an analog-to-digital converter (ADC), which is not limited here, so that the digital signal is used as the deformation feedback signal of the production workshop assembly line, and the threshold and range of the deformation feedback signal are set according to production requirements and equipment characteristics to ensure that the deformation feedback signal is within a reasonable control range.

[0092] In this embodiment, the programmable logic controller controls the operation of the industrial equipment on the production workshop assembly line according to the deformation feedback signal; in specific implementation, the programmable logic controller (PLC) receives the deformation feedback signal, performs data analysis and processing, and based on the received deformation feedback signal, the programmable logic controller automatically adjusts the equipment according to the preset control logic, for example, adjusts the production speed, operation mode or equipment status to optimize the production process and prevent further deformation and defects of the assembly line products.

[0093] It should be noted that the deformation feedback signal enables the production line to adjust the equipment operating parameters in real time according to the product deformation, thereby optimizing the production speed and process, and the programmable logic controller can respond quickly to the deformation feedback signal. Real-time deformation feedback can help identify potential problems and improve the robustness and stability of the industrial control system.

[0094] It can be seen that in the present application, the accuracy of deformation detection of assembly line products can be improved, and feedback control signals of industrial control systems can be generated based on precise deformation quantities; wherein, infrared light interference technology can detect tiny surface deformations and provide high-resolution phase information. Through phase shift extraction, continuous phase changes can be obtained, and then precise deformation quantities can be calculated. Moreover, through filtering technology, the influence of noise on data can be effectively reduced, thereby improving the signal-to-noise ratio of deformation detection; then, by utilizing interference phase information, a more comprehensive product surface state can be provided, and by comparing the interference reset image with the standard image, the product deformation can be more accurately quantified based on the phase difference, and the deviation from the standard state can be identified. Accurate deformation monitoring can improve the system's sensitivity to environmental changes and equipment failures, thereby improving the stability of the overall industrial control system; finally, the deformation feedback signal enables the production line to adjust the equipment operating parameters in real time according to the product deformation, thereby optimizing the production speed and process, and the programmable logic controller can quickly respond to the deformation feedback signal. Real-time deformation feedback can help identify potential problems and improve the robustness and stability of the industrial control system.

[0095] In summary, the technical solution adopted in this application can improve the accuracy of deformation detection of assembly line products, and generate feedback control signals of industrial control systems based on precise deformation quantities to improve the robustness of industrial control systems.

[0096] Embodiment 2

[0097] This application provides an industrial automation control system based on industrial vision, referring to Figure 4 As shown, this figure is a schematic diagram of a control system according to this embodiment of the present application, and the control system includes:

[0098] An image acquisition module 100 is used to acquire infrared interference image sets of products on the production line;

[0099] The information extraction module 200 is used to extract the phase shift of the infrared light interference image set to obtain the interference phase shift field of the pipeline product under infrared light interference, and to restore the surface of the pipeline product according to the interference phase shift field and infrared light interference parameters to obtain the object surface phase information of the pipeline product;

[0100] The deformation amount determination module 300 is used to obtain the interference phase information of the pipeline product, obtain the interference resetting image of the pipeline product through the interference phase information and the object plane phase information, and compare the interference resetting image with a given standard image to obtain the deformation amount of the pipeline product;

[0101] The feedback control module 400 is used to generate a deformation feedback signal of the production workshop assembly line according to the deformation amount of the assembly line product, and the programmable logic controller controls the operation of the industrial equipment on the production workshop assembly line according to the deformation feedback signal.

[0102] The present application is described with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0103] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, the storage medium including a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically-erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0104] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

Claims

1. An industrial automation control method based on industrial vision, characterized in that: The control method comprises the following steps: Collect infrared interference image sets of products on the production line; Performing phase shift extraction on the infrared light interference image set to obtain an interference phase shift field of the pipeline product under infrared light interference, and performing surface restoration on the pipeline product according to the interference phase shift field and infrared light interference parameters to obtain object surface phase information of the pipeline product; Acquire the interference phase information of the pipeline product, obtain the interference reconstructed image of the pipeline product through the interference phase information and the object plane phase information, and compare the interference reconstructed image with a given standard image to obtain the deformation amount of the pipeline product; A deformation feedback signal of the production workshop assembly line is generated by the deformation amount of the assembly line product, and a programmable logic controller controls the operation of industrial equipment on the production workshop assembly line according to the deformation feedback signal.

2. The industrial automation control method based on industrial vision according to claim 1, characterized in that: The infrared light interferometer is used to collect infrared light interference image sets of products on the production workshop assembly line.

3. The industrial automation control method based on industrial vision according to claim 1, characterized in that: Performing phase shift extraction on the infrared light interference image set to obtain the interference phase shift field of the production line product under infrared light interference specifically includes: For each infrared light interference image in the infrared light interference image set, sliding filtering is performed on the infrared light interference image to obtain a filtered infrared light interference image; Performing phase shift extraction on the filtered infrared light interference image to obtain a phase shift value corresponding to the infrared light interference image, and further obtaining a phase shift value corresponding to each infrared light interference image in the infrared light interference image set; The interference phase shift field of the production line products under infrared light interference is determined according to all the phase shift values.

4. The industrial automation control method based on industrial vision as claimed in claim 3, characterized in that: Sliding filtering is performed on the infrared light interference image to obtain the filtered infrared light interference image, which specifically includes: Set the pixel sliding domain; For each pixel point in the infrared light interference image, determining a brightness coefficient and a texture complexity of the pixel point according to the pixel sliding domain; The pixel points are filtered by using the brightness coefficient and the texture complexity to obtain filtered pixel points, and then a filtered infrared light interference image is obtained.

5. The industrial automation control method based on industrial vision according to claim 1, characterized in that: Performing surface restoration on the pipeline product according to the interference phase shift field and the infrared light interference parameter to obtain the object surface phase information of the pipeline product specifically includes: Determine all reset phase shift values ​​in the interference reset process of the assembly line product through the interference phase shift field and the interference distance in the infrared light interference parameter; The object plane phase information of the pipeline product is determined by all the reset phase shift values ​​and the infrared light wavelength in the infrared light interference parameters.

6. The industrial automation control method based on industrial vision according to claim 1, characterized in that: Acquiring the interference phase information of the pipeline product specifically includes: Performing phase recovery on each infrared light interference image in the infrared light interference image set to obtain an interference phase value of each infrared light interference image; The set of all interference phase values ​​is used as the interference phase information of the pipeline product.

7. The industrial automation control method based on industrial vision according to claim 1, characterized in that: Obtaining the interference resetting image of the pipeline product through the interference phase information and the object plane phase information specifically includes: generating a reset image of the pipeline product according to the interference phase information; The object plane phase information is used to perform phase compensation on the reconstructed image, thereby obtaining an interference reconstructed image of the assembly line product.

8. The industrial automation control method based on industrial vision according to claim 1, characterized in that: The interference reset image is compared with a given standard image to obtain the deformation amount of the assembly line product, which specifically includes: Respectively extracting the phase value of the interference restoration image and the phase value of the standard image; Comparing the phase value of the interference restoration image with the phase value of the standard image to obtain a phase difference; The ratio of the phase difference to the wavelength constant is taken as the deformation amount of the assembly line product.

9. The industrial automation control method based on industrial vision according to claim 1, characterized in that: Generating the deformation feedback signal of the production workshop assembly line according to the deformation amount of the assembly line product specifically includes: Converting the deformation amount of the assembly line product into a digital signal; The digital signal is used as a deformation feedback signal of the production workshop assembly line.

10. An industrial automation control system based on industrial vision, used to execute an industrial automation control method based on industrial vision as claimed in any one of claims 1 to 9, characterized in that: The control system comprises: Image acquisition module, used to collect infrared interference image sets of products on the production line; An information extraction module is used to perform phase shift extraction on the infrared light interference image set to obtain the interference phase shift field of the pipeline product under infrared light interference, and perform surface restoration on the pipeline product according to the interference phase shift field and infrared light interference parameters to obtain the object surface phase information of the pipeline product; A deformation amount determination module is used to obtain the interference phase information of the pipeline product, obtain the interference resetting image of the pipeline product through the interference phase information and the object plane phase information, and compare the interference resetting image with a given standard image to obtain the deformation amount of the pipeline product; The feedback control module is used to generate a deformation feedback signal of the production workshop assembly line according to the deformation amount of the assembly line product, and the programmable logic controller controls the operation of the industrial equipment on the production workshop assembly line according to the deformation feedback signal.

Images