Visual inspection system, method and equipment
By automatically adjusting the distance between the camera and the sample, the observation angle, and the observation range, image acquisition is optimized, solving the problem of insufficient image quality in complex industrial scenarios in existing technologies. This achieves higher acquisition accuracy and applicability, and supports 3D measurement and scene reconstruction.
Patent Information
- Application Number
- CN202411122833.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-15
- Publication Date
- 2024-11-26
AI Technical Summary
Existing machine vision inspection systems struggle to quickly and easily adjust camera environmental conditions in complex industrial settings, resulting in unsatisfactory image quality that requires manual adjustments, thus reducing efficiency.
Employing an image acquisition module, an image detection module, and an optical extension assembly, the system automatically adjusts the distance between the camera and the sample, the observation angle, and the observation range. Image acquisition is optimized through control signals from an independent light source and the image detection module, including adjustments to the position of the sample stage and detection components, and lens adjustment.
It improves the accuracy and applicability of image acquisition, enabling the acquisition of more detailed information under extreme lighting conditions. It is suitable for complex industrial scenarios and supports 3D measurement and scene reconstruction.
Smart Images

Figure CN119027631A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of image acquisition technology, and in particular to a visual inspection system, method and device. Background Art
[0002] In the prior art, a machine vision inspection system uses a camera to convert the inspected target into an image signal, which is then transmitted to a dedicated image processing system and converted into a digital signal based on pixel distribution, brightness, color and other information. The image processing system then performs various operations on these signals to extract the target's features, such as area, quantity, position, and length, and then outputs the results based on preset tolerances and other conditions, including size, angle, number, qualified / unqualified, presence / absence, etc., to achieve automatic recognition.
[0003] However, when the acquired image signal is unclear or does not meet the requirements, the above-mentioned machine vision inspection system usually requires manual adjustment of the inspection equipment, for example, manually adjusting the shooting angle of the camera, etc., which will greatly reduce the efficiency of the visual inspection equipment. Due to the complexity of industrial scenes, the above-mentioned machine vision inspection system cannot quickly and conveniently adjust the environmental conditions of the camera, and thus cannot ensure the image quality in various industrial scenes.
[0004] Based on this, there is an urgent need for a visual inspection solution that can automatically adjust the inspection equipment, improve the accuracy of acquisition, and be suitable for complex industrial scenarios. Summary of the invention
[0005] In view of this, the purpose of the present invention is to provide a visual inspection system, method and device that can automatically improve the distance between the camera and the sample, the observation angle and the observation range in complex industrial scenes, improve the accuracy of image acquisition, and obtain more detailed information under extreme lighting conditions, thereby improving the applicability of image detection. On this basis, it can also record the spatial position and angle information of the optical fiber, providing new possibilities for three-dimensional measurement and scene reconstruction.
[0006] In order to achieve the above purpose, the technical solution adopted by the embodiment of the present invention is as follows:
[0007] In a first aspect, the present invention provides a visual inspection system, comprising: an image acquisition module, an image detection module and an optical rod assembly, wherein the image acquisition module comprises a sampling unit and an illumination unit; the sampling unit and the illumination unit are both communicatively connected with the image detection module; the optical rod assembly comprises a first optical rod, and the sampling unit, the illumination unit and the image detection module are fixed on a mounting base surface of the visual inspection system through the first optical rod;
[0008] The lighting unit is used to provide at least one independent light source with a preset irradiation direction for the object to be measured;
[0009] The sampling unit is used to obtain the optical effect of the object to be tested under the illumination of the independent light source at a preset collection position to obtain a sample image;
[0010] The image detection module is used to receive the sample image and send a first control signal to the lighting unit according to the attribute parameters of the sample image to adjust the exposure of the sample image; and / or send a second control signal to the sampling unit according to the attribute parameters of the sample image to adjust the collection position of the sampling unit to improve the clarity of the sample image.
[0011] Furthermore, the image detection module at least includes a control unit; the sampling unit and the lighting unit are both in communication connection with the control unit;
[0012] The control unit is configured to send a first control signal to the lighting unit to adjust the exposure of the sample image when the attribute parameter of the sample image is less than a preset threshold;
[0013] And / or send a second control signal to the sampling unit to adjust the collection position of the sampling unit.
[0014] Further, the sampling unit includes a sample stage and a detection component; the detection component is communicatively connected with the image detection module; the sample stage is fixed to the mounting base of the visual detection system through the first optical connecting rod and the detection component; wherein the second control signal includes a third control signal, and the sample stage is used to carry the object to be detected;
[0015] The detection component is used to obtain a sample image of the object to be detected under the illumination of the lighting unit;
[0016] The image detection module is used to receive the sample image and when the attribute parameter of the sample image is less than a preset threshold,
[0017] A third control signal is sent to the sample stage and / or the detection component to adjust the distance between the sample stage and the detection component and / or adjust the angle between the normal of the plane where the sample stage is located and the normal of the plane where the detection component is located.
[0018] Furthermore, the optical rod assembly further includes a second optical rod; the sampling unit further includes a sample stage control unit; the sample stage control unit is communicatively connected with the image detection module and the sample stage; the sample stage control unit is also connected with the sample stage through the second optical rod; wherein, when the attribute parameter of the sample image is less than a preset threshold value, the image detection module is used to send a third control signal to the sample stage control unit;
[0019] The sample stage control unit is used to adjust the distance between the sample stage and the detection component and / or the angle between the normal line of the plane where the sample stage is located and the normal line of the plane where the detection component is located according to the third control signal.
[0020] Furthermore, the sample stage control unit includes two single-axis linear shift stages and one rotational shift stage, wherein the single-axis linear shift stage and the rotational shift stage are both communicatively connected to the image detection module to adjust the moving range of the single-axis linear shift stage and / or the rotational shift stage according to the third control signal, thereby changing the distance between the sample stage and the detection component and / or the angle between the normal of the plane where the sample stage is located and the normal of the plane where the detection component is located.
[0021] Further, the optical rod assembly includes a third optical rod; the detection assembly includes a detection module, the detection module includes a zoom lens and a lens adjustment unit, the zoom lens is connected to the lens adjustment unit through the third optical rod; the zoom lens is also fixed to the mounting base of the visual detection system through the first optical rod and the lighting unit; wherein the second control signal also includes a fourth control signal, and when the attribute parameter of the sample image is less than a preset threshold value, the image detection module is used to send the fourth control signal to the lens adjustment unit;
[0022] The lens adjustment unit is used to adjust the shooting range of the zoom lens according to the fourth control signal.
[0023] Further, the optical rod assembly includes a fourth optical rod; the lighting unit includes a light source adjustment unit and an annular light source, and the light source adjustment unit is connected to the annular light source through the fourth optical rod; the light source adjustment unit is also fixed to the mounting base of the visual inspection system through the first optical rod and the image detection module; wherein, when the attribute parameter of the sample image is less than a preset threshold, the image detection module is used to send a first control signal to the light source adjustment unit;
[0024] The light source adjustment unit is used to adjust the lighting direction of the annular light source according to the first control signal.
[0025] Furthermore, the optical connecting rod assembly includes a fifth optical connecting rod, and the lighting unit also includes an external light source, which is fixed to the mounting base of the visual inspection system through the fifth optical connecting rod; wherein the external light source is used to provide an independent light source with at least one preset illumination direction; the independent light source includes a light signal of at least one wavelength band to produce an optical effect with the object to be tested to obtain a sample image.
[0026] In a second aspect, the present invention further provides a visual inspection method, which is applied to the visual inspection system described in any one of the first aspects above, wherein the visual inspection system comprises: an image acquisition module, an image detection module and an optical connecting rod assembly, wherein the image acquisition module comprises a sampling unit and a lighting unit; the sampling unit and the lighting unit are both communicatively connected to the image detection module; the optical connecting rod assembly comprises a first optical connecting rod, and the sampling unit, the lighting unit and the image detection module are fixed on the mounting base surface of the visual inspection system through the first optical connecting rod; the visual inspection method comprises the steps of:
[0027] The lighting unit provides at least one independent light source with a preset irradiation direction for the object to be measured;
[0028] The sampling unit acquires the optical effect of the object to be tested under the illumination of the independent light source at a preset acquisition position to obtain a sample image;
[0029] Used to receive the sample image, and send a first control signal to the lighting unit according to the attribute parameters of the sample image to adjust the exposure of the sample image;
[0030] And / or sending a second control signal to the sampling unit according to the attribute parameters of the sample image to adjust the acquisition position of the sampling unit to improve the clarity of the sample image.
[0031] In a third aspect, the present invention further provides a visual inspection device, comprising the visual inspection system described in any one of the first aspects above.
[0032] The visual inspection system, method and device provided by the present invention have the following beneficial effects:
[0033] The visual inspection system comprises: an image acquisition module, an image detection module and an optical rod assembly, wherein the image acquisition module comprises a sampling unit and an illumination unit; the sampling unit and the illumination unit are both connected to the image detection module in communication; the optical rod assembly comprises a first optical rod, and the sampling unit, the illumination unit and the image detection module are fixed on the mounting base of the visual inspection system through the first optical rod. The illumination unit is used to provide an independent light source with at least one preset illumination direction for the object to be tested. The sampling unit is used to obtain the optical effect of the object to be tested under the illumination of the independent light source at a preset acquisition position to obtain a sample image. The image detection module is used to receive the sample image, and send a first control signal to the illumination unit according to the attribute parameters of the sample image to adjust the exposure of the sample image; and / or send a second control signal to the sampling unit according to the attribute parameters of the sample image to adjust the acquisition position of the sampling unit to adjust the clarity of the sample image. The present invention can automatically improve the distance between the camera and the sample, the observation angle and the observation range, improve the accuracy of image acquisition, obtain more detailed information under extreme illumination, and improve the applicability of image detection.
[0034] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.
[0036] Figure 1 One of the structural schematic diagrams of the visual inspection system provided by the present invention is shown;
[0037] Figure 2 The second structural schematic diagram of the visual inspection system provided by the present invention is shown;
[0038] Figure 3 One of the structural schematic diagrams of the lighting unit in the present invention is shown;
[0039] Figure 4 The third structural schematic diagram of the visual inspection system provided by the present invention is shown;
[0040] Figure 5 One of the structural schematic diagrams of the sampling unit in the present invention is shown;
[0041] Figure 6 The second structural schematic diagram of the sampling unit in the present invention is shown;
[0042] Figure 7 The third structural schematic diagram of the sampling unit in the present invention is shown;
[0043] Figure 8 The second structural schematic diagram of the lighting unit in the present invention is shown;
[0044] Fig. 9 A flow chart of the steps of the visual inspection method of the present invention is shown.
[0045] Icons: 100- visual inspection system; 101- image acquisition module; 102- image detection module; 103- optical connecting rod assembly; 201- sampling unit; 202- lighting unit; 203- control unit; 204- external light source; 301- first optical connecting rod; 302- second optical connecting rod; 303- third optical connecting rod; 304- fourth optical connecting rod; 305- fifth optical connecting rod; 401- sample stage; 402- detection assembly; 403- sample stage control unit; 501- detection module; 502- zoom lens; 503- lens adjustment unit; 601- light source adjustment unit; 602- ring light source. DETAILED DESCRIPTION
[0046] The following will be combined with the accompanying drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.
[0047] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present invention.
[0048] It should be noted that relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0049] As described in the background technology, the machine vision inspection system cannot adapt to complex industrial scenarios, and when the acquired image is unclear or does not meet the requirements, manual adjustment of the equipment is required. This process will greatly increase labor costs and reduce the efficiency of visual inspection equipment.
[0050] Based on this, the present invention provides a visual inspection solution that can automatically adjust the inspection equipment, improve the acquisition accuracy, and is suitable for complex industrial scenarios.
[0051] The above-mentioned visual inspection scheme will be described in detail below.
[0052] First, please refer to Figure 1 The present invention provides a visual inspection system 100, comprising: an image acquisition module 101, an image detection module 102 and an optical connecting rod assembly 103, wherein the image acquisition module 101 is connected to the image detection module 102 through the optical connecting rod assembly 103.
[0053] Among them, please refer to Figure 2 In this embodiment, the image acquisition module 101 includes a sampling unit 201 and an illumination unit 202; the sampling unit 201 and the illumination unit 202 are both in communication connection with the image detection module 102. The optical connecting rod assembly 103 includes a first optical connecting rod 301, and the sampling unit 201, the illumination unit 202 and the image detection module 102 are fixed on the mounting base surface of the visual detection system 100 through the first optical connecting rod 301.
[0054] In this embodiment, the visual inspection system is set on a horizontal mounting base, and the mounting base can be selected according to actual needs. For example, a high-level standard optical laboratory table or a high-level standard optical board can be selected. In the visual inspection system, the image acquisition module and the image detection module are fixed by an optical connecting rod assembly, and the optical connecting rod assembly is used to realize the movement of the image acquisition module and / or the image detection module, thereby changing the setting method during the acquisition process and adjusting the clarity of the sample image.
[0055] Among them, in this embodiment, an optical connecting rod assembly is used to complete the fixation and connection. The optical connecting rod assembly can also improve the degree of freedom of the visual inspection system, adapt to the requirements of different angles and different experimental environments, and increase the applicability of the visual inspection system.
[0056] The lighting unit provides at least one independent light source in a preset irradiation direction for the object to be tested, and the sampling unit obtains the optical effect of the object to be tested under the irradiation of the independent light source at a preset collection position to obtain a sample image.
[0057] Please refer to Figure 3In a possible implementation, the optical rod assembly 103 includes a fifth optical rod 305, and the lighting unit 202 includes an external light source 204, which is fixed to the mounting base of the visual inspection system 100 through the fifth optical rod 305. In this embodiment, the external light source is used to provide an independent light source with at least one preset irradiation direction; the independent light source includes a light signal of at least one band to produce an optical effect with the object to be tested to obtain a sample image. For example, if there is a certain gap in the object to be tested, a series of emission and refraction effects may occur under the irradiation of the independent light source according to the depth-to-width ratio of the gap, thereby presenting a certain spectrum and obtaining a sample image. In this embodiment, the fifth optical rod may be a magic arm with a high degree of freedom, so that the external light source can freely adjust the angle to irradiate the object to be tested through the fifth optical rod in the space where the visual inspection system is located. Generally, when the object to be tested is tested, after the external light source provides an independent light source with at least one preset irradiation direction, the preset irradiation direction may not be changed in the subsequent adjustment process.
[0058] The image detection module receives the sample image and sends a first control signal to the lighting unit according to the attribute parameters of the sample image to adjust the illumination angle of the independent light source; and / or sends a second control signal to the sampling unit according to the attribute parameters of the sample image to adjust the collection position of the sampling unit to adjust the clarity of the sample image.
[0059] It should be noted that the attribute parameters of the sample image in this embodiment may include pixels, resolution, size, color, bit depth, hue, saturation, brightness, color channels, etc., which can be selected according to the actual use process and can be any parameter or a combination of any multiple parameters. This embodiment does not limit the specific type or number of the attribute parameters. Instead, the attribute parameters of the corresponding sample image are determined by the image detection module to determine whether the image clarity meets the requirements, and then adjust the acquisition unit and / or the lighting unit, for example, by sending a first control signal to the lighting unit to adjust the illumination angle of the independent light source; and / or sending a second control signal to the sampling unit to adjust the acquisition position of the sampling unit.
[0060] In one possible implementation, please refer to Figure 4 In this embodiment, the image detection module 102 at least includes a control unit 203; the sampling unit 201 and the lighting unit 202 are both in communication connection with the control unit 203.
[0061] The control unit is used to send a first control signal to the lighting unit to adjust the exposure of the sample image when the attribute parameter of the sample image is less than a preset threshold; and / or send a second control signal to the sampling unit to adjust the collection position of the sampling unit.
[0062] In one possible implementation, the control unit includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program: receiving a sample image in real time, and when an attribute parameter of the sample image is less than a preset threshold, sending a first control signal to the lighting unit to adjust the exposure of the sample image; and / or sending a second control signal to the sampling unit to adjust the collection position of the sampling unit.
[0063] In this embodiment, please refer to Figure 5 The sampling unit 201 includes a sample stage 401 and a detection component 402; the detection component 402 is communicatively connected with the image detection module 102; the sample stage 401 is fixed to the mounting base of the visual detection system 100 through the first optical connecting rod 301 and the detection component 402. The sample stage 401 is used to carry the object to be tested. The detection component 402 is used to obtain a sample image of the object to be tested under the illumination of the lighting unit 202. In a possible implementation, the detection component 402 can be arranged above the sample stage 401, so that the detection component 402 can obtain a sample image of the object to be tested under the illumination of the lighting unit 202.
[0064] In this embodiment, the collection position of the sampling unit can be adjusted by adjusting the distance between the sample stage and the detection component and / or the angle between the normal of the plane where the sample stage is located and the normal of the plane where the detection component is located, thereby changing the horizontal position of the object to be measured on the sample stage and the distance to the detection component, thereby improving image clarity.
[0065] In one possible implementation, the second control signal includes a third control signal, the image detection module receives a sample image, and when an attribute parameter of the sample image is less than a preset threshold, sends a third control signal to the sample stage and / or the detection component to adjust the distance between the sample stage and the detection component, and / or adjust the angle between the normal of the plane where the sample stage is located and the normal of the plane where the detection component is located.
[0066] In this embodiment, the rotation direction and / or height of the sample stage can be improved by the third control signal. Figure 6 The optical rod assembly 103 also includes a second optical rod 302; the sampling unit 201 also includes a sample stage control unit 403; the sample stage control unit 403 is connected to the image detection module 102 and the sample stage 401 in communication; the sample stage control unit 403 is also connected to the sample stage 401 through the second optical rod 302; wherein, when the attribute parameter of the sample image is less than a preset threshold, the image detection module is used to send a third control signal to the sample stage control unit. Please continue to refer to Figure 6In this embodiment, in order to ensure accurate control of the sample stage, the sample stage control unit 403 can be disposed on the first optical rod 301, and the sample stage 401 can be fixed to the sample stage control unit 403 via the second optical rod 302. The sample stage control unit adjusts the distance between the sample stage and the detection component and / or the angle between the normal line of the plane where the sample stage is located and the normal line of the plane where the detection component is located according to the third control signal.
[0067] In one possible implementation, the sample stage control unit includes two single-axis linear shift stages and one rotational shift stage, wherein the single-axis linear shift stage and the rotational shift stage are both communicatively connected to the image detection module to adjust the moving range of the single-axis linear shift stage and / or the rotational shift stage according to a third control signal, thereby changing the distance between the sample stage and the detection component and / or the angle between the normal of the plane where the sample stage is located and the normal of the plane where the detection component is located.
[0068] In this embodiment, in order to change the distance between the sample stage and the detection component and / or the angle between the normal of the plane where the sample stage is located and the normal of the plane where the detection component is located, two single-axis linear shift stages and one rotation shift stage in the sample stage control unit can constitute an XYZ three-axis device. It can be understood that the two single-axis linear shift stages can move on the X axis and the Y axis respectively, and the rotation shift stage can achieve 360° rotation. Then, when the attribute parameter of the sample image is less than the preset threshold, that is, the clarity of the corresponding sample image does not meet the preset requirements, the single-axis linear shift stage in the X direction and / or the single-axis linear shift stage in the Y direction and / or the rotation shift stage can be adjusted accordingly through the third control signal. For example, the rotation shift stage can be adjusted first to change the angle between the normal of the plane where the sample stage is located and the normal of the plane where the detection component is located, so that the surface of the sample stage is perpendicular to the detection component, and then the single-axis linear shift stage in the X direction and / or the single-axis linear shift stage in the Y direction are adjusted accordingly to shorten the distance between the sample stage and the detection component, thereby making the sample image clearer.
[0069] In another possible implementation, the distance between the sample stage and the detection component can be changed by adjusting the observation position of the detection component. Please refer to Figure 7 The optical connecting rod assembly 103 includes a third optical connecting rod 303; the detection assembly 402 includes a detection module 501, the detection module 501 includes a zoom lens 502 and a lens adjustment unit 503, the zoom lens 502 is connected to the lens adjustment unit 503 through the third optical connecting rod 303; the lens adjustment unit 503 is also fixed to the mounting base surface of the visual detection system through the first optical connecting rod 301 and the lighting unit 202; wherein the second control signal also includes a fourth control signal, when the attribute parameter of the sample image is less than a preset threshold, the image detection module is used to send the fourth control signal to the lens adjustment unit.
[0070] The lens adjustment unit is used for adjusting the shooting range of the zoom lens according to the fourth control signal.
[0071] In this embodiment, an industrial camera can be connected to the zoom lens to obtain the sample image generated on the zoom lens through the process camera and provide it to the image detection module. Similar to the previous embodiment, the lens adjustment unit may include two single-axis linear displacement stages to form an XY dual-axis device. It can be understood that the two single-axis linear displacement stages can move on the X-axis and Y-axis respectively, thereby adjusting the position of obtaining the sample image and changing the shooting range.
[0072] To make the sample image clearer, please refer to Figure 8 The optical rod assembly 103 includes a fourth optical rod 304; the lighting unit 202 also includes a light source adjustment unit 601 and an annular light source 602, and the light source adjustment unit 601 is connected to the annular light source 602 through the fourth optical rod 304; the light source adjustment unit 601 is also fixed to the mounting base of the visual inspection system 100 through the first optical rod 301 and the image detection module 102. When the attribute parameter of the sample image is less than the preset threshold, the image detection module is used to send a first control signal to the light source adjustment unit.
[0073] The light source adjustment unit is used to adjust the lighting direction of the annular light source according to the first control signal.
[0074] Similar to the previous embodiment, the light source adjustment unit in this embodiment may include two single-axis linear shift stages and one rotary shift stage. The single-axis linear shift stage and one rotary shift stage may constitute an XYZ three-axis device. It can be understood that the two single-axis linear shift stages may be moved on the X-axis and the Y-axis respectively, and the rotary shift stage may realize 360° rotation. Furthermore, when the attribute parameter of the sample image is less than the preset threshold value, that is, the clarity of the corresponding sample image does not meet the preset requirements, the single-axis linear shift stage in the X direction and / or the single-axis linear shift stage and / or the rotary shift stage in the Y direction may be adjusted correspondingly through the fifth control signal to change the illumination direction of the annular light source and adjust the exposure of the object to be tested, thereby making the sample image clearer. In this embodiment, the illumination direction of the annular light source may change with the height of the detection component, especially the height of the zoom lens. For example, the illumination direction of the annular light source is adjusted with the height of the zoom lens, and the center of the annular light source and the center of the zoom lens are kept on the same axis.
[0075] In a possible implementation, in this embodiment, the image detection module can also detect specific samples and screen the yield rate of the samples. For example, when marking on the surface of the sample using a marking machine, each symbol is composed of a plurality of small holes arranged and combined, but whether the shape of each hole and the hole depth ratio meet the standard, this platform is required for detection. For example, the hole depth ratio of each hole is designed to be 60um:100um, and the error rate is + / -2um to be qualified. When a traditional camera is used to collect pictures from the top, only two-dimensional picture information of the hole can be obtained, such as the diameter size, whether it is circular, etc., and the depth information of the hole cannot be obtained. The present invention can expose the object to be tested at a preset angle, such as from the oblique side, through an external independent light source, to capture multiple sample images and determine the depth value of the hole. Then, according to the corresponding preset value, for example, each sample will have a standard value and an error range before leaving the factory. Based on this, the object to be tested can be judged, and then the samples to be tested can be tested in batches to screen out good and bad products.
[0076] In summary, the present invention provides a visual inspection system, including: an image acquisition module, an image detection module and an optical rod assembly, the image acquisition module includes a sampling unit and an illumination unit; the sampling unit and the illumination unit are both connected to the image detection module in communication; the optical rod assembly includes a first optical rod, and the sampling unit, the illumination unit and the image detection module are fixed on the mounting base of the visual inspection system through the first optical rod. The illumination unit is used to provide at least one independent light source with a preset illumination direction for the object to be tested. The sampling unit is used to obtain the optical effect of the object to be tested under the illumination of the independent light source at a preset acquisition position to obtain a sample image. The image detection module is used to receive the sample image, and send a first control signal to the illumination unit according to the attribute parameters of the sample image to adjust the exposure of the sample image; and / or send a second control signal to the sampling unit according to the attribute parameters of the sample image to adjust the acquisition position of the sampling unit to adjust the clarity of the sample image. The present invention can automatically improve the distance between the camera and the sample, the observation angle and the observation range in complex industrial scenes, improve the accuracy of image acquisition, and obtain more detailed information under extreme illumination, thereby improving the applicability of image detection. On this basis, it is also possible to record the spatial position and angle information of the optical fiber, providing new possibilities for three-dimensional measurement and scene reconstruction.
[0077] In the second aspect, in order to execute the corresponding steps in the above embodiments and various possible methods, a method for implementing a visual inspection system device is provided below. Optionally, the visual inspection system can adopt the above Figure 1 as well as Figure 2 The present invention also provides a visual inspection method, which is applied to the visual inspection system 100 of any one of the first aspects, please refer to Fig. 9 , the visual detection method of the present invention comprises the steps of:
[0078] Step 110: The lighting unit provides at least one independent light source with a preset irradiation direction for the object to be measured.
[0079] Step 120: The sampling unit acquires the optical effect of the object to be tested under the illumination of the independent light source at a preset acquisition position to obtain a sample image.
[0080] Step 130: The image detection module receives the sample image and sends a first control signal to the lighting unit according to the attribute parameters of the sample image to adjust the exposure of the sample image; and / or sends a second control signal to the sampling unit according to the attribute parameters of the sample image to adjust the collection position of the sampling unit to improve the clarity of the sample image.
[0081] The visual inspection method provided by the present invention can automatically improve the distance between the camera and the sample, the observation angle and the observation range, improve the accuracy of image acquisition, and obtain more detailed information under extreme lighting conditions, thereby improving the applicability of image inspection. On this basis, it can also record the spatial position and angle information of the optical fiber, providing new possibilities for three-dimensional measurement and scene reconstruction.
[0082] Furthermore, the present invention also provides a visual inspection device, including any visual inspection system of the first aspect. It should be noted that the basic principle and technical effects of the visual inspection device provided in this embodiment are the same as those in the above embodiment. For the sake of brief description, for the parts not mentioned in this embodiment, reference can be made to the corresponding contents in the above embodiment.
[0083] In summary, the visual inspection system, method and device provided by the embodiments of the present invention can automatically improve the distance between the camera and the sample, the observation angle and the observation range in complex industrial scenes, improve the accuracy of image acquisition, and obtain more detailed information under extreme lighting conditions, thereby improving the applicability of image inspection. On this basis, it can also record the spatial position and angle information of the optical fiber, providing new possibilities for three-dimensional measurement and scene reconstruction.
[0084] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.
[0085] In addition, the functional modules in the various embodiments of the present invention may be integrated together to form an independent part, or each module may exist independently, or two or more modules may be integrated to form an independent part.
[0086] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
[0087] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. A visual inspection system, characterized in that: include: An image acquisition module, an image detection module and an optical rod assembly, wherein the image acquisition module includes a sampling unit and an illumination unit; the sampling unit and the illumination unit are both in communication connection with the image detection module; the optical rod assembly includes a first optical rod, and the sampling unit, the illumination unit and the image detection module are fixed on the mounting base surface of the visual detection system through the first optical rod; The lighting unit is used to provide at least one independent light source with a preset irradiation direction for the object to be measured; The sampling unit is used to obtain the optical effect of the object to be tested under the illumination of the independent light source at a preset collection position to obtain a sample image; The image detection module is used to receive the sample image and send a first control signal to the lighting unit according to the attribute parameters of the sample image to adjust the exposure of the sample image; and / or send a second control signal to the sampling unit according to the attribute parameters of the sample image to adjust the collection position of the sampling unit to improve the clarity of the sample image.
2. The visual inspection system according to claim 1, characterized in that: The image detection module at least includes a control unit; the sampling unit and the lighting unit are both in communication connection with the control unit; The control unit is configured to send a first control signal to the lighting unit to adjust the exposure of the sample image when the attribute parameter of the sample image is less than a preset threshold; And / or send a second control signal to the sampling unit to adjust the collection position of the sampling unit.
3. The visual inspection system according to claim 1, characterized in that: The sampling unit includes a sample stage and a detection component; the detection component is in communication connection with the image detection module; the sample stage is fixed to the mounting base of the visual detection system through the first optical connecting rod and the detection component; wherein the second control signal includes a third control signal, and the sample stage is used to carry the object to be detected; The detection component is used to obtain a sample image of the object to be detected under the illumination of the lighting unit; The image detection module is used to receive the sample image and when the attribute parameter of the sample image is less than a preset threshold, A third control signal is sent to the sample stage and / or the detection component to adjust the distance between the sample stage and the detection component and / or adjust the angle between the normal of the plane where the sample stage is located and the normal of the plane where the detection component is located.
4. The visual inspection system according to claim 3, characterized in that: The optical rod assembly further includes a second optical rod; the sampling unit further includes a sample stage control unit; the sample stage control unit is in communication connection with the image detection module and the sample stage; the sample stage control unit is also connected to the sample stage through the second optical rod; wherein, when the attribute parameter of the sample image is less than a preset threshold, The image detection module is used to send a third control signal to the sample stage control unit; The sample stage control unit is used to adjust the distance between the sample stage and the detection component and / or the angle between the normal line of the plane where the sample stage is located and the normal line of the plane where the detection component is located according to the third control signal.
5. The visual inspection system according to claim 4, characterized in that: The sample stage control unit includes two single-axis linear shift stages and one rotation shift stage, wherein the single-axis linear shift stage and the rotation shift stage are both communicatively connected to the image detection module to adjust the moving range of the single-axis linear shift stage and / or the rotation shift stage according to the third control signal, thereby changing the distance between the sample stage and the detection component and / or the angle between the normal of the plane where the sample stage is located and the normal of the plane where the detection component is located.
6. The visual inspection system according to claim 3, characterized in that: The optical rod assembly includes a third optical rod; the detection assembly includes a detection module, the detection module includes a zoom lens and a lens adjustment unit, the zoom lens is connected to the lens adjustment unit through the third optical rod; the zoom lens is also fixed to the mounting base of the visual detection system through the first optical rod and the lighting unit; wherein the second control signal also includes a fourth control signal, when the attribute parameter of the sample image is less than a preset threshold, The image detection module is used to send a fourth control signal to the lens adjustment unit; The lens adjustment unit is used to adjust the shooting range of the zoom lens according to the fourth control signal.
7. The visual inspection system according to claim 1 or 3, characterized in that: The optical rod assembly includes a fourth optical rod; the lighting unit includes a light source adjustment unit and an annular light source, and the light source adjustment unit is connected to the annular light source through the fourth optical rod; the light source adjustment unit is also fixed to the mounting base of the visual inspection system through the first optical rod and the image detection module; wherein, when the attribute parameter of the sample image is less than a preset threshold, The image detection module is used to send a first control signal to the light source adjustment unit; The light source adjustment unit is used to adjust the lighting direction of the annular light source according to the first control signal.
8. The visual inspection system according to claim 1 or 2, characterized in that: The optical rod assembly includes a fifth optical rod, and the lighting unit also includes an external light source, which is fixed to the mounting base of the visual inspection system through the fifth optical rod; wherein, The external light source is used to provide an independent light source with at least one preset irradiation direction; the independent light source includes a light signal of at least one wavelength band to produce an optical effect with the object to be tested to obtain a sample image.
9. A visual inspection method, characterized in that: The visual inspection system applied to any one of claims 1 to 8 comprises: an image acquisition module, an image detection module and an optical rod assembly, wherein the image acquisition module comprises a sampling unit and an illumination unit; the sampling unit and the illumination unit are both communicatively connected with the image detection module; the optical rod assembly comprises a first optical rod, and the sampling unit, the illumination unit and the image detection module are fixed on the mounting base of the visual inspection system through the first optical rod; the visual inspection method comprises the steps of: The lighting unit provides at least one independent light source with a preset irradiation direction for the object to be measured; The sampling unit acquires the optical effect of the object to be tested under the illumination of the independent light source at a preset acquisition position to obtain a sample image; Used to receive the sample image, and send a first control signal to the lighting unit according to the attribute parameters of the sample image to adjust the exposure of the sample image; And / or sending a second control signal to the sampling unit according to the attribute parameters of the sample image to adjust the acquisition position of the sampling unit to improve the clarity of the sample image.
10. A visual inspection device, characterized in that: A visual inspection system comprising any one of claims 1 to 8.
