Sheet metal surface defect detection device based on multi-modal fusion technology

Abstract

The utility model provides a sheet metal surface defect detection device based on a multi-modal fusion technology, which belongs to the technical field of industrial detection and specifically comprises a detection body, a roller way conveying system is arranged in the detection body and used for conveying a sheet metal body, and the detection body is provided with a detection module. A three-dimensional scanning detection system and a two-dimensional shooting detection system are arranged on the roller way conveying system, the three-dimensional scanning detection system and the two-dimensional shooting detection system are used for shooting a plate body, and a partition plate is arranged between the three-dimensional scanning detection system and the two-dimensional shooting detection system. According to the utility model, a modularized and closed detection design thought is adopted, and each functional unit such as the roller way conveying device, the three-dimensional scanning detection system and the two-dimensional shooting detection system can be independently disassembled and assembled, so that the maintenance and the upgrading are convenient. Different modules can flexibly adjust related parameters of the device according to actual detection requirements, accurate positioning and detection are achieved, the device adapts to various metal plate specifications and production line layouts, and the universality and adaptability of the device are improved.

Description

TECHNICAL FIELD

[0001] The utility model belongs to the industrial detection technical field especially relates to a metal sheet surface defect detection device based on multimodal fusion technique. BACKGROUND

[0002] In modern industrial production, metal sheet as important basic material is widely used in aviation, automobile, building, household appliance and other fields. The quality of metal sheet surface directly influences the use performance and appearance of product, therefore, the detection of its surface defect is the indispensable link in industrial production process.

[0003] Traditional surface defect detection mainly includes artificial detection and single mode machine vision detection. Artificial detection depends on the experience and visual judgment of inspector, although the flexibility is higher, but its efficiency is low, and there is big subjectivity and the risk of misjudgment and omission, difficult to meet the demand of large-scale industrial production, single mode machine vision detection usually adopts optical imaging technology, and identifies defects by extracting the characteristics of surface defects, since the metal surface texture is complex, the light reflection is strong, and the environmental light interference is big, single mode detection is difficult to effectively cope with some complex defect types and scene changes, and the detection precision and robustness are difficult to meet the demand of high-precision detection.

[0004] Therefore, a metal sheet surface defect detection device based on multimodal fusion technology is needed to solve the above problems. UTILITY MODEL CONTENTS

[0005] To solve the above technical problems, the utility model provides a metal sheet surface defect detection device based on multimodal fusion technology.

[0006] To achieve the above purpose, the utility model provides a metal sheet surface defect detection device based on multimodal fusion technology, including detection body, the roller conveyor system is arranged in the detection body, the roller conveyor system is used for conveying the sheet body, the roller conveyor system is provided with three-dimensional scanning detection system and two-dimensional shooting detection system, the three-dimensional scanning detection system and two-dimensional shooting detection system are used for shooting the sheet body, the three-dimensional scanning detection system and two-dimensional shooting detection system are provided with the baffle.

[0007] Preferably, the roller conveyor system includes the sliding guide rail fixed on the detection body, a plurality of roller slides are slidably connected to the sliding guide rail, and a foot mounting member is fixed to the roller slide.

[0008] Preferably, the roller conveyor system further includes an adjustable foot fixed to the foot mounting member, a channel steel support is fixed to the adjustable foot, a U-shaped channel steel is fixed to the channel steel support, and a driving assembly is arranged in the U-shaped channel steel.

[0009] Preferably, the driving assembly comprises a driving motor fixed on one side of the U-shaped channel steel, an output shaft of the driving motor extends into the U-shaped channel steel and is drivingly connected with a shaft coupling, the shaft coupling is drivingly connected with a roller, and the roller is used for conveying the plate body.

[0010] Preferably, the three-dimensional scanning detection system comprises transmission assemblies symmetrically arranged on the detection body, any one of the transmission assemblies is connected with a hand-operated wheel, the transmission assembly comprises a worm bearing seat fixed on the detection body, the hand-operated wheel is drivingly connected with a worm through the worm bearing seat, two sides of the worm are drivingly connected with worm gears, the worm gears are drivingly connected with a lifting assembly and a connecting assembly.

[0011] Preferably, the connecting assembly comprises a bevel gear fixed on the worm gear, a bevel gear transmission shaft is connected in the middle of the bevel gear, a bevel gear transmission shaft bearing seat is arranged on the detection body, and the bevel gear transmission shaft is rotatably connected through the bevel gear transmission shaft bearing seat.

[0012] Preferably, the lifting assembly comprises a lead screw bearing seat fixed on the detection body, a lifting mounting plate is fixed on the detection body, a lead screw is fixed in the middle of the worm gear, the lead screw is rotatably connected with the lead screw bearing seat and the lifting mounting plate respectively, a threaded flange is threadedly connected on the lead screw, an object supporting plate is threadedly connected on the threaded flange, and a first moving assembly is fixed on the object supporting plate.

[0013] Preferably, the first moving assembly comprises an optical axis support fixed on the object supporting plate, an optical axis is fixed between the two optical axis supports, a locking sliding block is slidably connected on the optical axis, a linear laser sensor mounting piece is fixed on the bottom end of the locking sliding block, and a linear laser sensor is arranged on the linear laser sensor mounting piece.

[0014] Preferably, the two-dimensional shooting detection system comprises a Z-axis sliding rail fixed on the detection body, a detection sliding block is slidably connected on the Z-axis sliding rail, a sliding profile mounting piece is fixed on the detection sliding block, and a second moving assembly is fixed on the sliding profile mounting piece.

[0015] Preferably, the second moving assembly comprises a sliding profile fixed on the sliding profile mounting piece, an industrial camera mounting piece is slidably connected on the sliding profile, and an industrial camera is fixed on the industrial camera mounting piece.

[0016] Compared with the prior art, the utility model has the advantages and technical effects that:

[0017] The device realizes multi-angle and multi-dimensional information collection of the surface defects of the metal plate by combining a three-dimensional scanning detection system and a two-dimensional shooting detection system through a multi-modal fusion technology. The three-dimensional scanning detection system acquires three-dimensional contour information of the surface of the plate body, accurately detects shape feature defects such as plate shape, scratches and pits, and can capture the small deformation and depth information of the metal surface; the two-dimensional shooting detection system acquires high-resolution images, and identifies detail texture feature defects such as fine cracks and color differences. The two systems work together to effectively make up for the shortcomings of a single detection method, improve the detection accuracy and reliability, and meet the demand of high-precision detection of the industrial production line.

[0018] The utility model discloses adopt modularization, closed detection design idea, and each functional unit such as roller way conveying device, three-dimensional scanning detection system, two-dimensional shooting detection system can be independently disassembled, and it is convenient to maintain and upgrade. Different module can flexibly adjust the related parameters of the device according to actual detection demand, realizes accurate positioning and detection, adapts to various metal plate specifications and production line layout, improves the versatility and adaptability of equipment.

[0019] By combining three-dimensional scanning data and two-dimensional image data, the device can extract multi-dimensional features of the metal surface defects, such as depth information, shape features and texture features, and then apply advanced algorithms for data fusion and defect identification. The comprehensive utilization of such multi-modal information can effectively improve the recognition ability of various complex defects, including scratches, pits and oxidation spots. BRIEF DESCRIPTION OF DRAWINGS

[0020] The accompanying drawings, which form a part of this application, are included to provide a further understanding of the application and are incorporated in and constitute a part of this application. The embodiments of the present application illustrated in the drawings and their descriptions are used to explain the present application and are not intended to limit the present application. In the drawings:

[0021] Figure 1 It is a whole structure perspective view of the utility model;

[0022] Figure 2 It is a whole structure first perspective view of the utility model;

[0023] Figure 3 It is a whole structure second perspective view of the utility model;

[0024] Figure 4 It is a roller way conveying device structure perspective view of the utility model;

[0025] Figure 5 It is a three-dimensional scanning detection system structure perspective view of the utility model;

[0026] Figure 6 It is a Z-axis lifting mechanism structure perspective view of the three-dimensional scanning detection system of the utility model;

[0027] Figure 7 It is a two-dimensional shooting detection system structure perspective view of the utility model;

[0028] In the figure: 1, detection body; 2, partition; 3, roller conveying system; 4, three-dimensional scanning detection system; 5, two-dimensional shooting detection system; 301, plate body; 302, driving motor; 303, coupling; 310, conveying roller; 311, roller cylinder; 312, roller cylinder bearing seat; 320, roller bracket; 321, U-shaped channel steel; 322, channel steel bracket; 323, adjustable foot; 331, foot mounting; 332, roller slide block; 333, sliding guide rail; 401, line laser sensor; 402, line laser sensor mounting; 411, optical axis; 412, locking slide block; 413, optical axis bracket; 421, lifting mounting plate; 422, hand-operated operating wheel; 423, worm bearing seat; 424, worm wheel; 425, worm; 426, silk shaft bearing seat; 427, silk shaft; 428, object holding plate; 429, threaded flange; 4210, bevel gear; 4211, bevel gear transmission shaft; 4212, bevel gear transmission shaft bearing seat; 501, industrial camera; 502, industrial camera mounting; 503, sliding profile; 511, Z-axis sliding rail; 512, detection slide block; 513, sliding profile mounting. DETAILED DESCRIPTION

[0029] The technical solutions in the embodiments of the utility model will be described clearly and completely below with reference to the drawings in the embodiments of the utility model. Obviously, the described embodiments are only part of the embodiments of the utility model, not all the embodiments. Based on the embodiments in the utility model, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the utility model.

[0030] In order to make the above-mentioned purposes, features and advantages of the utility model more obvious and easy to understand, the utility model will be further described in detail below with reference to the drawings and specific embodiments.

[0031] Referring to Figures 1-7 As shown in the figure, the utility model provides a kind of metal plate surface defect detection device based on multimodal fusion technology, including detection body 1, detection body 1 is provided with roller conveying system 3, roller conveying system 3 is used to convey plate body 301, roller conveying system 3 is provided with three-dimensional scanning detection system 4 and two-dimensional shooting detection system 5, three-dimensional scanning detection system 4 and two-dimensional shooting detection system 5 are used to shoot plate body 301, three-dimensional scanning detection system 4 and two-dimensional shooting detection system 5 are provided with partition 2.

[0032] The device realizes multi-angle and multi-dimensional information acquisition of the surface defects of the plate body 301 through the multi-modal fusion technology, which combines the three-dimensional scanning detection system 4 and the two-dimensional shooting detection system 5. The three-dimensional scanning detection system 4 acquires the three-dimensional contour information of the surface of the plate body 301, accurately detects the shape feature defects such as plate shape, scratches and pits, and can capture the small deformation and depth information of the metal surface. The two-dimensional shooting detection system 5 captures high-resolution images to identify the detailed texture feature defects such as fine cracks and color differences. The two systems work together to effectively make up for the shortcomings of single detection means, improve the detection accuracy and reliability, and meet the needs of high-precision detection of industrial production lines.

[0033] Further optimization scheme, the roller conveying system 3 includes a sliding guide rail 333 fixed on the detection body 1, a plurality of roller sliding blocks 332 are slidably connected on the sliding guide rail 333, and a foot mounting piece 331 is fixed on the roller sliding block 332.

[0034] The roller sliding blocks 332 on the sliding guide rail 333 can be adjusted according to the specifications of the produced plate body 301, and the spacing between the roller sliding blocks 332 is adjusted.

[0035] Further optimization scheme, the roller conveying system 3 further includes an adjustable foot 323 fixed on the foot mounting piece 331, a channel steel support 322 is fixed on the adjustable foot 323, and a U-shaped channel steel 321 is fixed on the channel steel support 322. A driving assembly is arranged in the U-shaped channel steel 321.

[0036] The adjustable foot 323 can ensure that the plate body 301 is stably conveyed on the roller 311, and the channel steel support 322 facilitates the installation of the driving assembly.

[0037] Further optimization scheme, the driving assembly includes a driving motor 302 fixed on one side of the U-shaped channel steel 321, the output shaft of the driving motor 302 extends into the U-shaped channel steel 321 and is drivingly connected with a shaft coupling 303, the shaft coupling 303 is drivingly connected with a roller 311, and the plate body 301 is conveyed on the roller 311.

[0038] The driving motor 302 can drive the shaft coupling 303 to rotate, the rotating shaft coupling 303 can drive the roller 311 to rotate, and the rotating rollers 311 can convey the plate body 301.

[0039] Further optimization scheme, the three-dimensional scanning detection system 4 includes transmission assemblies symmetrically arranged on the detection body 1, wherein any transmission assembly is connected with the hand-operated wheel 422, the transmission assembly includes a worm bearing seat 423 fixedly connected to the detection body 1, the hand-operated wheel 422 is transmissionally connected with a worm 425 penetrating through the worm bearing seat 423, the worm 425 is transmissionally connected with a worm wheel 424 on both sides, and the worm wheel 424 is transmissionally connected with a lifting assembly and a connecting assembly.

[0040] The hand-operated wheel 422 is shaken, so that the hand-operated wheel 422 rotates with the worm, the worm rotates with the worm wheel 424, so that the worm wheel 424 works with the lifting assembly and the connecting assembly.

[0041] Further optimization scheme, the connecting assembly includes a bevel gear 4210 fixedly connected to the worm wheel 424, a bevel gear transmission shaft 4211 is connected in the middle of the bevel gear 4210, a bevel gear transmission shaft bearing seat 4212 is installed on the detection body 1, and the bevel gear transmission shaft 4211 is rotationally connected through the bevel gear transmission shaft bearing seat 4212.

[0042] When the worm wheel 424 rotates to drive the bevel gear 4210 fixedly connected in the middle to rotate, the bevel gear transmission shaft 4211 meshing with the bevel gear 4210 rotates on the bevel gear transmission shaft 4211 bearing seat.

[0043] Further optimization scheme, the lifting assembly includes a wire shaft bearing seat 426 fixedly connected to the detection body 1, a lifting mounting plate 421 is fixedly connected to the detection body 1, a wire shaft 427 is fixedly connected in the middle of the worm wheel 424, the wire shaft 427 is rotationally connected with the wire shaft bearing seat 426 and the lifting mounting plate 421 respectively, a threaded flange 429 is threadedly connected to the wire shaft 427, a supporting plate 428 is threadedly connected to the threaded flange 429, and a first moving assembly is fixedly connected to the supporting plate 428.

[0044] When the wire shaft 427 rotates, the threaded flange 429 lifts and moves with the supporting plate 428, and drives the first moving assembly to move in the moving process.

[0045] Further optimization scheme, the first moving assembly includes an optical axis support 413 fixedly connected to the supporting plate 428, an optical axis 411 is fixedly connected between the two optical axis supports 413, a locking sliding block 412 is slidingly connected to the optical axis 411, a linear laser sensor mounting piece 402 is fixedly connected to the bottom end of the locking sliding block 412, and a linear laser sensor 401 is installed on the linear laser sensor mounting piece 402.

[0046] When the optical axis support 413 moves to the appropriate distance with the optical axis 411, only the locking slider 412 needs to be adjusted in the position of the optical axis 411 and locked, so as to select the appropriate height distance to detect the plate body 301 by using the line laser sensor 401.

[0047] Further optimization scheme, the two-dimensional shooting detection system 5 includes the Z-axis sliding rail 511 fixed on the detection body 1, the detection slider 512 is slidably connected on the Z-axis sliding rail 511, the sliding profile mounting piece 513 is fixed on the detection slider 512, and the second moving assembly is fixed on the sliding profile mounting piece 513; the second moving assembly includes the sliding profile 503 fixed with the sliding profile mounting piece 513, the industrial camera mounting piece 502 is slidably connected on the sliding profile 503, and the industrial camera 501 is fixed on the industrial camera mounting piece 502.

[0048] By adjusting the appropriate shooting detection position of the industrial camera 501 on the sliding profile 503, and by moving the height of the detection slider 512 on the Z-axis sliding rail 511, it is ensured that each industrial camera 501 can completely and effectively shoot and detect the surface of the metal plate body 301.

[0049] Working principle:

[0050] In use, first, the staff places the metal plate surface multi-modal defect detection device at the metal plate production in / out end to prepare for multi-modal defect detection on the metal surface, then according to the specifications of the produced plate body 301, adjusts the distance between the roller slide blocks 332 connected with each roller support 320 in the roller conveyor device on the sliding guide rail 333, to control the distance between each conveying roller 310, at the same time checks and adjusts the adjustable foot 323 on each roller support 320, to ensure that the plate body 301 is stably conveyed on each roller 311. Then, by adjusting the correct scanning field position of each locking slider 412 on the optical axis 411 in the three-dimensional scanning detection system 4, and then locking and fixing, and by rotating the hand-operated operating wheel 422 to adjust the correct scanning range height position of the line laser sensor 401 on the wire shaft 427, it is ensured that each line laser sensor 401 can accurately and effectively scan and detect the surface of the plate body 301. Next, by adjusting the appropriate shooting detection position of the industrial camera 501 on the sliding profile 503 in the two-dimensional shooting detection system 5, and by moving the height of the detection slider 512 on the Z-axis sliding rail 511, it is ensured that each industrial camera 501 can completely and effectively shoot and detect the surface of the plate body 301.

[0051] When the metal plate surface multi-modal defect detection device can effectively detect the specifications of the plate body 301, each line laser sensor 401 and the industrial camera 501 in the multi-modal detection device are started, and each drive motor 302 in the roller conveying device is started. Then, the staff places the plate body 301 on the conveying roller 310 at the end of the three-dimensional scanning detection system 4, and then drives the roller 311 by the drive motor 302, and transmits the metal plate body 301 into the three-dimensional scanning detection system 4 and the two-dimensional shooting detection system 5 in turn, so as to implement multi-modal detection on the surface of the plate body 301. Among them, the three-dimensional scanning detection system 4 uses the line laser sensor 401 to obtain the three-dimensional profile information of the surface of the plate body 301, accurately detects the shape feature defects such as plate shape, scratches and pits, and can capture the small deformation and depth information of the metal surface; the two-dimensional shooting detection system 5 captures high-resolution images through the industrial camera 501, and identifies the detailed texture feature defects such as fine cracks and color differences.

[0052] After the current plate body 301 is detected, the staff can observe and analyze the detected multi-dimensional quality data of the surface of the metal plate body 301 through the data processing software of the line laser sensor 401 and the industrial camera 501, and save the data. At the same time, the staff sequentially performs the above metal plate surface multi-modal detection on the subsequent plate body 301, so as to realize the purpose of efficiently detecting the surface of the batch-produced metal plate in industrial production.

[0053] In the description of the utility model, it is understood that the orientation or position relationship indicated by the terms "longitudinal", "transverse", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer" and the like is the orientation or position relationship shown in the drawings, and is only for the convenience of describing the utility model, and does not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, therefore it cannot be understood as a limitation on the utility model.

[0054] The above-described embodiments are only preferred modes of the utility model, and do not limit the scope of the utility model, and various deformations and improvements of the technical scheme of the utility model made by those skilled in the art without departing from the design spirit of the utility model should fall within the protection scope determined by the claims of the utility model.

Claims

1. A metal plate surface defect detection device based on a multi-modal fusion technology, characterized in that: The utility model relates to a kind of plate detection device, including detection body (1), roller conveyor system (3) is arranged in the detection body (1), the roller conveyor system (3) is used to convey plate body (301), three-dimensional scanning detection system (4) and two-dimensional shooting detection system (5) are arranged on the roller conveyor system (3), and three-dimensional scanning detection system (4) and two-dimensional shooting detection system (5) are used to shoot plate body (301), and partition (2) is arranged between three-dimensional scanning detection system (4) and two-dimensional shooting detection system (5).

2. The metal sheet surface defect detection device based on multi-modal fusion technology according to claim 1, characterized in that: The roller conveyor system (3) includes a sliding guide rail (333) fixed to the detection body (1), a plurality of roller slides (332) are slidingly connected to the sliding guide rail (333), and a ground anchor (331) is fixed to the roller slides (332).

3. The metal sheet surface defect detection device based on multi-modal fusion technology according to claim 2, characterized in that: The roller conveyor system (3) further includes an adjustable ground anchor (323) fixed to the ground anchor (331), a channel steel support (322) is fixed to the adjustable ground anchor (323), a U-shaped channel steel (321) is fixed to the channel steel support (322), and a drive assembly is arranged in the U-shaped channel steel (321).

4. The metal sheet surface defect detection device based on multi-modal fusion technology according to claim 3, characterized in that: The drive assembly includes a drive motor (302) fixed to one side of the U-shaped channel steel (321), an output shaft of the drive motor (302) extends into the U-shaped channel steel (321) and is drivingly connected to a shaft coupling (303), the shaft coupling (303) is drivingly connected to a roller (311), and the plate body (301) is conveyed on the roller (311).

5. The metal sheet surface defect detection device based on multi-modal fusion technology according to claim 1, characterized in that: The three-dimensional scanning detection system (4) includes a transmission assembly symmetrically arranged on the detection body (1), and any transmission assembly is connected to a hand-operated wheel (422). The transmission assembly includes a worm bearing seat (423) fixed to the detection body (1), the hand-operated wheel (422) is drivingly connected to a worm (425) through the worm bearing seat (423), both sides of the worm (425) are drivingly connected to a worm gear (424), and the worm gear (424) is drivingly connected to a lifting assembly and a connecting assembly.

6. The metal sheet surface defect detection device based on multi-modal fusion technology according to claim 5, characterized in that: The connecting assembly includes a bevel gear (4210) fixed to the worm gear (424), a bevel gear transmission shaft (4211) is connected to the middle of the bevel gear (4210), a bevel gear transmission shaft bearing seat (4212) is installed on the detection body (1), and the bevel gear transmission shaft (4211) is rotatably connected through the bevel gear transmission shaft bearing seat (4212).

7. The metal sheet surface defect detection device based on multi-modal fusion technology according to claim 6, characterized in that: The lifting assembly comprises a wire shaft bearing seat (426) fixed on the detection body (1), a lifting mounting plate (421) is fixed on the detection body (1), a wire shaft (427) is fixed in the middle of the worm wheel (424), the wire shaft (427) is rotatably connected with the wire shaft bearing seat (426) and the lifting mounting plate (421) respectively, a threaded flange (429) is threadedly connected on the wire shaft (427), a supporting plate (428) is threadedly connected on the threaded flange (429), and a first moving assembly is fixed on the supporting plate (428).

8. The metal sheet surface defect detection device based on multi-modal fusion technology according to claim 7, characterized in that: The first moving assembly comprises an optical axis support (413) fixed with the supporting plate (428), an optical axis (411) is fixed between the two optical axis supports (413), a locking sliding block (412) is slidably connected on the optical axis (411), a linear laser sensor mounting piece (402) is fixed at the bottom end of the locking sliding block (412), and a linear laser sensor (401) is installed on the linear laser sensor mounting piece (402).

9. The metal sheet surface defect detection device based on multi-modal fusion technology according to claim 1, characterized in that: The two-dimensional shooting detection system (5) comprises a Z-axis sliding rail (511) fixed on the detection body (1), a detection sliding block (512) is slidably connected on the Z-axis sliding rail (511), a sliding profile mounting piece (513) is fixed on the detection sliding block (512), and a second moving assembly is fixed on the sliding profile mounting piece (513).

10. The metal sheet surface defect detection device based on multi-modal fusion technology according to claim 9, characterized in that: The second moving assembly comprises a sliding profile (503) fixed with the sliding profile mounting piece (513), an industrial camera mounting piece (502) is slidably connected on the sliding profile (503), and an industrial camera (501) is fixed on the industrial camera mounting piece (502).

Images