Chain appearance detection device and method

By designing chain detection equipment for multiple sets of light source groups and cameras, combined with semantic segmentation algorithms, the problems of low accuracy and high cost of chain detection are solved, and efficient and accurate chain appearance detection is achieved.

CN113008894BActive Publication Date: 2024-12-03NINGBO NUOSHI INTELLIGENT TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110103206.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-01-26
Publication Date
2024-12-03
Estimated Expiration
2041-01-26

AI Technical Summary

Technical Problem

The existing chain detection methods are complex chain structure and numerous inspection items, resulting in low detection accuracy and high cost, and low manual inspection efficiency, which are prone to missed and missed inspections.

Method used

Design a chain appearance detection device, including a camera for shooting chains and multiple light source groups, identify fault information through different detection mode switching and semantic segmentation algorithms, increase compatibility for multiple chain appearance detection, simplify the detection process and Reduce costs.

Benefits of technology

It improves the accuracy and efficiency of chain detection, reduces the detection cost, realizes compatible detection of the appearance of multiple chains, and simplifies the inspection process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113008894B_ABST
    Figure CN113008894B_ABST
Patent Text Reader

Abstract

The present invention relates to a chain appearance detection device and method, the device comprising: a first camera for photographing a first side surface of a chain; wherein the first side surface is the side surface where the outer link piece of the chain is located; a first light source group and a second light source group are arranged on both sides of the first camera; wherein the first light source group irradiates the first side surface to illuminate the outer link piece; the second light source group irradiates the two sides of the rivet on the outer link piece, so that the two sides of the rivet are brighter than other positions on the outer link piece. On the one hand, the compatibility with multiple chain appearance detections is increased to improve the detection accuracy; on the other hand, the detection process is simplified and the detection cost is reduced by using one device for detection.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of chain detection, and in particular to a chain appearance detection device and method. Background Art

[0002] In the mass production process, it is impossible for humans to stare at the chain for a long time to see if there are any defects. Using human eyes to check product quality is inefficient and very easy to cause eye fatigue. Using machine detection methods can greatly improve production efficiency and the degree of automation of production.

[0003] However, in the existing automated inspection process, due to the complex chain structure and numerous inspection items, on the one hand, if a set of solutions is used to inspect the chain, missed detection and wrong detection are prone to occur, reducing the inspection accuracy of each inspection item; on the other hand, if a device is designed for each inspection item, the inspection process becomes complicated and the inspection cost is greatly increased. Summary of the invention

[0004] The purpose of the present invention is to propose a chain appearance inspection device and method, which, on the one hand, increases the compatibility with multiple chain appearance inspections to improve the inspection accuracy; on the other hand, uses one device for inspection, simplifies the inspection process and reduces the inspection cost.

[0005] To achieve the above-mentioned purpose, the first aspect of the present application provides a chain appearance inspection device, comprising:

[0006] A first camera for photographing a first side of the chain; wherein the first side is the side where the outer link of the chain is located;

[0007] A first light source group and a second light source group are disposed on both sides of the first camera;

[0008] The first light source group illuminates the first side surface to illuminate the outer link piece; the second light source group illuminates both sides of the rivet on the outer link piece, so that both sides of the rivet are brighter than other positions on the outer link piece.

[0009] Furthermore, the second light source group is distributed on both sides of the first camera, and the second light source group on each side includes at least two light sources and is arranged around the chain.

[0010] Furthermore, it also includes: a mounting component;

[0011] The mounting component mounts the chain vertically and controls the chain to rotate so that the first camera traverses and photographs all outer link plates on the chain.

[0012] Furthermore, it also includes:

[0013] a second camera for photographing a second side surface of the chain, the second side surface being the side surface where the rollers of the chain are located;

[0014] A third light source group is disposed on both sides of the second camera.

[0015] Furthermore, it includes: the number of the first cameras is two, which are respectively arranged on the two first side surfaces of the chain, wherein the two first side surfaces are the front side and the back side of the chain.

[0016] To achieve the above-mentioned purpose, the second aspect of the present application provides a chain appearance detection method, which is applied to any chain appearance detection device described in the first aspect, and the method comprises:

[0017] Configure the detection mode for each camera and light source combination;

[0018] Switching the detection modes in sequence to use the corresponding camera and light source combination in the detection mode to shoot the chain and obtain an image;

[0019] According to the images taken in each detection mode, the fault information of the chain is identified.

[0020] Furthermore, the sequentially switching the detection modes to use the corresponding camera and light source combination in the detection mode to shoot the chain to obtain an image includes:

[0021] Entering a first detection mode, in which a first light source group is turned on, and a first camera is used to photograph the chain to obtain a first image;

[0022] Exiting the first detection mode to turn off the first light source group;

[0023] Entering a second detection mode, to turn on a second light source group in the second detection mode, and using the first camera to photograph the chain to obtain a second image;

[0024] Exit the second detection mode to turn off the second light source group.

[0025] Furthermore, the identifying the fault information of the chain according to the images captured in each detection mode includes:

[0026] Using a semantic segmentation algorithm to identify the images taken in each detection mode, respectively, to obtain the location and category of defects in the chain;

[0027] The position and type of the defect are used as the defect information of the chain.

[0028] Further, after exiting the second detection mode, the method further includes:

[0029] Entering a third detection mode, to turn on a third light source group in the third detection mode, and using a second camera to photograph the chain to obtain a third image;

[0030] Exit the third detection mode to turn off the third light source group.

[0031] Furthermore, it also includes:

[0032] When the first cameras are disposed on both the first side surfaces of the chain, the first detection mode and the second detection mode are sequentially performed on each first side surface.

[0033] As can be seen from the above, the technical solution provided by the present application uses a first camera for photographing the first side of the chain; wherein the first side is the side where the outer link of the chain is located; a first light source group and a second light source group are arranged on both sides of the first camera; wherein the first light source group irradiates the first side to illuminate the outer link; the second light source group irradiates the two sides of the rivet on the outer link, so that the two sides of the rivet are brighter than other positions on the outer link, which solves the problems of low detection accuracy and high detection cost caused by the complex chain structure and numerous detection items. On the one hand, it increases the compatibility with multiple chain appearance detection to improve the detection accuracy; on the other hand, the use of one device for detection simplifies the detection process and reduces the detection cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1A This is a schematic structural diagram of a chain appearance inspection device provided in Example 1 of the present invention;

[0035] Figure 1B This is a schematic diagram of the irradiation effect of a chain provided in Example 1 of the present invention;

[0036] Figure 1C This is a schematic diagram of another irradiation effect of a chain provided in Example 1 of the present invention;

[0037] Figure 2A This is a flow chart of a chain appearance detection method provided in Example 2 of the present invention;

[0038] Figure 2B A schematic diagram of the chain front detection content provided in Example 2 of the present invention;

[0039] Figure 2C A schematic diagram of the second side detection content of the chain provided in Embodiment 2 of the present invention;

[0040] Figure 2D This is a schematic diagram of the chain back detection content provided in Example 2 of the present invention. DETAILED DESCRIPTION

[0041] The following examples are used to illustrate the present invention but are not intended to limit the scope of the present invention.

[0042] Example 1

[0043] The present application provides a chain appearance detection device. Figure 1A is a schematic structural diagram of a chain appearance inspection device provided in Example 1 of the present invention, Figure 1B This is a schematic diagram of the irradiation effect of a chain provided in Example 1 of the present invention, Figure 1C This is a schematic diagram of another illumination effect of a chain provided in Example 1 of the present invention.

[0044] Reference Figure 1A The device may include the following structures: a first camera 1 for photographing a first side of the chain, a first light source group 11 and a second light source group 12.

[0045] The first side is the side where the outer link of the chain is located, which generally corresponds to Figure 1A The front or back of the chain shown in .

[0046] Furthermore, a first light source group 11 and a second light source group 12 are disposed on both sides of the first camera 1 .

[0047] The first light source group 11 and the second light source group 12 can be configured as a combination of multiple light sources and distributed on both sides of the first camera 1. Figure 1A As shown, one light source is disposed on both sides of each first camera 1 to form a first light source group 11 ; four light sources are disposed on both sides of each first camera 1 to form a second light source group 12 .

[0048] In one embodiment, in the light source group, multiple light sources distributed on the same side of the first camera 1 can be arranged in a surrounding manner. For example, the first light source group 11 or the second light source group 12 is distributed on both sides of the first camera 1, and the first light source group 11 or the second light source group 12 on each side includes at least two light sources and is arranged in a surrounding chain.

[0049] In a specific embodiment, referring to Figure 1A , the angle between two adjacent light sources can be set to 30°.

[0050] By using the surround setting, it can be ensured that the light source can be concentrated on the chain, thereby increasing the brightness of the chain, thereby improving the imaging quality of the first camera 1 to reflect more details of the chain.

[0051] Further, see Figure 1B and Figure 1C The first light source group 11 illuminates the first side surface to illuminate the outer link of the chain; the second light source group 12 illuminates both sides of the rivet on the outer link, making both sides of the rivet brighter than other positions on the outer link.

[0052] In one embodiment, the first light source group 11 is arranged at a distribution range of 30° to the left and right of the outer link of the chain; the second light source group 12 is arranged at a distribution range of 68° to the left and right of the outer link of the chain.

[0053] It should be noted that when the first light source group 11 or the second light source group 12 on each side has multiple light sources, the light source in the middle position can be used as the position of the multiple light sources, and further, the distribution range of the first light source group 11 or the second light source group 12 can be determined based on the middle position.

[0054] In this embodiment, the first light source group 11 and the second light source group 12 can be switched to obtain different illumination effects.

[0055] In the technical solution provided in this embodiment, by configuring multiple groups of light sources for the first camera 1, and each group of light sources has different illumination effects, further, in different detection chain inspection items, such as different structures in different detection chains, corresponding illumination effects can be switched, thereby solving the problems of low detection accuracy and high detection cost caused by complex chain structures and numerous detection items. On the one hand, compatibility with multiple chain appearance inspections is increased to improve detection accuracy; on the other hand, the use of one device for inspection simplifies the inspection process and reduces the inspection cost.

[0056] Based on the above technical solution, the device also includes: a mounting component; the mounting component mounts the chain vertically and controls the rotation of the chain so that the first camera 1 can traverse and photograph all external links on the chain without replacing other equipment or flipping the chain, thereby simplifying the complexity of the detection process and reducing equipment costs.

[0057] On the basis of the above technical solution, the device also includes:

[0058] A second camera 2 for photographing a second side surface of the chain, wherein the second side surface is the side surface where the roller of the chain is located;

[0059] A third light source group (not shown) is disposed on both sides of the second camera 2. The configuration of the third light source group (not shown) can refer to the first light source group 11, and can illuminate the side where the roller of the chain is located.

[0060] Based on the above technical solution, the device includes: two first cameras 1, which are respectively arranged on two first side surfaces of the chain, wherein the two first side surfaces are the front and back surfaces of the chain. When the chain is controlled to rotate by the mounting component, the front and back surfaces of the chain can be photographed at the same time without turning the chain, thereby simplifying the complexity of the detection process and reducing the equipment cost.

[0061] Further, see Figure 1A The two first cameras 1 may also be arranged alternately to prevent the reflection of the lens of one first camera 1 from affecting the shooting of another first camera 1 .

[0062] On the basis of the above technical solution, the light sources in the first light source group 11 and the second light source group 12 are one or a combination of strip light, coaxial light bowl light and square light.

[0063] Among them, the strip light is a starlight band, which cannot achieve 360° surround lighting, but has a certain directionality; the coaxial light is ideal parallel light after polarization and reflection; the bowl light and square light can achieve 360° uniform surround light, which is a shadowless light source.

[0064] In this embodiment, various types of light sources can be used individually or in combination according to actual needs.

[0065] Example 2

[0066] Figure 2A This is a flow chart of a chain appearance detection method provided in Example 2 of the present invention; Figure 2B A schematic diagram of the chain front detection content provided in Example 2 of the present invention; Figure 2C A schematic diagram of the second side detection content of the chain provided in Embodiment 2 of the present invention; Figure 2D This is a schematic diagram of the chain back detection content provided in Example 2 of the present invention.

[0067] This embodiment provides a chain appearance detection method, which is applied to the chain appearance detection device provided in Embodiment 1. Figure 2A , the method may specifically include the following steps:

[0068] S210: configuring a detection mode for each combination of camera and light source group.

[0069] In this embodiment, under different detection modes, it can be used to detect different chain appearance detection items, such as the defect condition of the chain outer link, the defect condition of the rivet on the outer link, the riveting condition, etc.

[0070] Furthermore, by using different light source groups, different illumination effects can be presented on the chain to adapt to different appearance inspection items. Figure 1C The illumination effect is achieved by using the second light source group alone to illuminate the two sides of the rivet on the outer link sheet, so that the two sides of the rivet are brighter than other positions on the outer link sheet, which is suitable for appearance inspection items such as rivet defects and riveting conditions.

[0071] S220, switching the detection modes in sequence to use the corresponding camera and light source combination in the detection mode to shoot the chain to obtain an image.

[0072] In this embodiment, during use, each detection mode is independent of each other and works in a switching manner to avoid mutual interference between light source groups.

[0073] In one embodiment, for the front side or side of the chain, step S220 may be refined to perform the following steps:

[0074] S221, entering a first detection mode, to turn on a first light source group in the first detection mode, and use a first camera to photograph the chain to obtain a first image;

[0075] S222, exiting the first detection mode to turn off the first light source group;

[0076] S223, entering a second detection mode, to turn on a second light source group in the second detection mode, and use the first camera to photograph the chain to obtain a second image;

[0077] S224: Exit the second detection mode to turn off the second light source group.

[0078] It should be noted that when the first cameras are disposed on both first side surfaces of the chain, the first detection mode and the second detection mode are sequentially performed on each first side surface.

[0079] Furthermore, when the device is further provided with a second camera and a third light source group, similarly, step S220 can also be further refined to include the following steps:

[0080] S225, entering a third detection mode, to turn on a third light source group in the third detection mode, and use a second camera to photograph the chain to obtain a third image;

[0081] S226: exit the third detection mode to turn off the third light source group.

[0082] Of course, the order of the first detection mode, the second detection mode and the third detection mode can be changed, and only one detection mode can be entered at the same time.

[0083] S230: Identify fault information of the chain according to the images captured in each detection mode.

[0084] In this embodiment, a semantic segmentation algorithm can be used to identify the images taken in each detection mode respectively to obtain the location and category of defects in the chain; the location and category of the defects are used as the defect information of the chain.

[0085] In this embodiment, the semantic segmentation algorithm, also known as the image semantic segmentation algorithm, aims to mark each pixel in the image and associate each pixel with the category it represents. In this embodiment, the location and category of defects in the chain can be identified.

[0086] Exemplarily, the semantic segmentation algorithm can be implemented using a deep learning network, such as a convolutional neural network.

[0087] In this embodiment, the chain fault information can be specifically used to reflect the following detection contents.

[0088] 1. Positive detection content

[0089] Reference Figure 2B , the positive detection content can include the following:

[0090] Chain piece color: detect the position of the color corresponding to the chain piece, whether the color meets the color specified in the formula, and whether the color fluctuation does not affect the detection judgment. Chain piece color, for example: silver white, blue, copper, paint milky white, paint orange and black, etc.

[0091] Position of the engraved code: Detect the engraved code and measure the content of the characters.

[0092] Chain piece contour: Check whether the chain piece contour meets the type of external chain piece selected in the recipe. The focus is on the inner and outer edges of the chain piece.

[0093] Missing corners of the chain plate: missing contours / missing corners of the chain plate; irregular outer edges of the chain plate, wear and scratches, etc.

[0094] Breakage or hole edge damage: The silver pin of the chain is not concentric with the hole of the chain, causing concentric arc damage to the hole edge around the pin during assembly, and breakage / warping around the pin.

[0095] Chain cracks: Radiating cracks around the pins and chain plates due to tension, with a width greater than 0.5mm.

[0096] Scratches: There should be no scratches or paint peeling around the chain surface.

[0097] Small rivets or missing rivets: The degree of riveting is too small or the rivets are missing.

[0098] Rust: Rust on the surface of the chain.

[0099] Pins: Broken and peeled.

[0100] 2. Side detection content

[0101] Reference Figure 2C , the side detection content can include the following:

[0102] Width: The distance between the upper side of the upper chain piece and the lower side of the lower chain piece.

[0103] Pin height: The height above and below the two pins on each link.

[0104] Chain Thickness: The thickness of each inner and outer chain.

[0105] Scratches and chippings on the inside and outside of the chain plates: Detection of scratches, cracks, discoloration and chippings on the inner and outer chain plates.

[0106] 3. Back detection content

[0107] Reference Figure 2D , the back detection content can include the following:

[0108] Chain Color: Detect the color of the bottom outer chain.

[0109] Position of the engraved code: Detect the content of the engraved code characters.

[0110] Chain piece profile: Check whether the chain piece profile conforms to the type of external chain piece selected in the recipe.

[0111] Missing corners of chain pieces: detect missing / missing corners of the peripheral contour of the chain pieces, irregular outer edges of the chain pieces, wear and scratches, etc.

[0112] Breakage or hole edge damage: Part of the chain, especially the breakage / warping around the pin. Arc-shaped damage to the hole edge around the pin.

[0113] Chain cracks: cracks around the pins and chain, radial or other switch cracks.

[0114] Scratches: Detect scratches around the chain surface.

[0115] Small rivets or missing rivets: The degree of riveting is too small or the rivets are missing.

[0116] Rust: Rust on the surface of the chain.

[0117] Pins: Broken and peeled.

[0118] In the technical solution provided in this embodiment, a detection mode is configured for each combination of a camera and a light source group; the detection modes are switched in sequence to use the corresponding camera and light source combination under the detection mode to shoot the chain and obtain an image; based on the images shot under each detection mode, the fault information of the chain is identified. On the one hand, compatibility with multiple chain appearance detections is increased to improve detection accuracy; on the other hand, the use of one device for detection simplifies the detection process and reduces the detection cost.

[0119] Example 3

[0120] Embodiment 3 of the present invention further provides a storage medium containing computer executable instructions, wherein the computer executable instructions are used to execute a chain appearance detection method when executed by a computer processor, including:

[0121] A first camera for photographing a first side of the chain; wherein the first side is the side where the outer link of the chain is located;

[0122] A first light source group and a second light source group are disposed on both sides of the first camera;

[0123] The first light source group illuminates the first side surface to illuminate the outer link piece; the second light source group illuminates both sides of the rivet on the outer link piece, so that both sides of the rivet are brighter than other positions on the outer link piece.

[0124] Of course, the storage medium containing computer executable instructions provided in an embodiment of the present invention, whose computer executable instructions are not limited to the operations of the chain appearance detection method as described above, can also execute related operations in the chain appearance detection method provided in any embodiment of the present invention, and have corresponding functions and beneficial effects.

[0125] Through the above description of the implementation method, the technicians in the relevant field can clearly understand that the present invention can be implemented by software and necessary general hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, in essence or the part that contributes to the prior art, can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions for a computer device (which can be a robot, a personal computer, a server, or a network device, etc.) to perform the chain appearance detection method described in any embodiment of the present invention.

[0126] It is worth noting that in the above-mentioned chain appearance inspection device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0127] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0128] In the description of this specification, the description with reference to the terms "in one embodiment", "in another embodiment", "exemplary" or "in a specific embodiment" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0129] Although the present invention has been described in detail above by means of general description, specific implementation methods and tests, it is obvious to those skilled in the art that some modifications or improvements may be made to the present invention. Therefore, these modifications or improvements made without departing from the spirit of the present invention all fall within the scope of protection claimed by the present invention.

Claims

1. A chain appearance inspection device, characterized in that: include: A first camera for photographing a first side of the chain; wherein the first side is the side where the outer link of the chain is located; A first light source group and a second light source group are disposed on both sides of the first camera; The first light source group irradiates the first side surface to illuminate the outer link; the second light source group irradiates the two sides of the rivet on the outer link, so that the two sides of the rivet are brighter than other positions on the outer link; the light sources in the first light source group and the second light source group are one or a combination of strip light, coaxial light bowl light and square light; a second camera for photographing a second side surface of the chain, the second side surface being the side surface where the rollers of the chain are located; A third light source group is disposed on both sides of the second camera.

2. The device according to claim 1, characterized in that The second light source groups are distributed on both sides of the first camera. The second light source groups on each side include at least two light sources and are arranged around the chain.

3. The device according to claim 1, characterized in that Also includes: Mounting parts; The mounting component mounts the chain vertically and controls the chain to rotate so that the first camera traverses and photographs all outer link plates on the chain.

4. The device according to claim 1, characterized in that include: The number of the first cameras is two, which are respectively arranged on the two first side surfaces of the chain, wherein the two first side surfaces are the front side and the back side of the chain respectively.

5. A chain appearance detection method, characterized in that: Applied to the chain appearance inspection device according to any one of claims 1 to 4, the method comprises: Configure the detection mode for each camera and light source combination; Switching the detection modes in sequence to use the corresponding camera and light source group combination in the detection mode to shoot the chain to obtain an image, including: Entering a first detection mode, in which a first light source group is turned on, and a first camera is used to photograph the chain to obtain a first image; Exiting the first detection mode to turn off the first light source group; Entering a second detection mode, to turn on a second light source group in the second detection mode, and using the first camera to photograph the chain to obtain a second image; Exiting the second detection mode to turn off the second light source group; The light sources in the first light source group and the second light source group are one or a combination of strip light, coaxial light bowl light and square light; According to the images taken in each detection mode, the fault information of the chain is identified.

6. The method according to claim 5, characterized in that The identifying the fault information of the chain according to the images taken in each detection mode includes: Using a semantic segmentation algorithm to identify the images taken in each detection mode, respectively, to obtain the location and category of defects in the chain; The position and type of the defect are used as the defect information of the chain.

7. The method according to claim 5, characterized in that After exiting the second detection mode, the method further includes: Entering a third detection mode, to turn on a third light source group in the third detection mode, and using a second camera to photograph the chain to obtain a third image; Exit the third detection mode to turn off the third light source group.

8. The method according to any one of claims 6-7, characterized in that: Also includes: When the first cameras are disposed on both the first side surfaces of the chain, the first detection mode and the second detection mode are sequentially performed on each first side surface.