System and method for visual detection of redundant objects based on deep learning in mechanical assembly

A technology of deep learning and visual inspection, applied in the field of artificial intelligence, can solve problems affecting the normal operation of high-reliability equipment, large human factors, manual inspection, etc., and achieve the effect of meeting real-time detection requirements, high recognition accuracy, and flexible use

Active Publication Date: 2020-06-16
ZHEJIANG UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If these redundant substances are left in the equipment, it will leave serious safety hazards, which may affect the normal operation of high-reliability equipment, and even cause malfunctions and safety accidents.
[0003] After long-term development, the current redundant detection and control methods mainly include visual and auditory detection, endoscopic detection, X-ray perspective detection, ultrasonic detection, Matera detection and particle collision noise detection, etc. , with more and stricter detection steps
However, most automatic detection methods are only suitable for fully assembled objects, and manual inspection is often used in assembly, and there are still problems such as large human factors and easy missed inspections.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for visual detection of redundant objects based on deep learning in mechanical assembly
  • System and method for visual detection of redundant objects based on deep learning in mechanical assembly
  • System and method for visual detection of redundant objects based on deep learning in mechanical assembly

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0046] The method for visual detection of redundant objects in mechanical assembly includes the following steps:

[0047] Step 1: Turn on the light source and camera. Multiple cameras collect image signals of the area where the assembly is located during mechanical assembly from multiple angles, and convert the image signals into digital electrical signals and send them to the vision controller.

[0048] Step 2: The vision controller is connected to the camera through the interface line to collect a large number of images of the historical assembly process. After preprocessing, the objects in the images are manually identified, and the type number, center coordinates, width and height of each object are marked, and the data is constructed. The data set is randomly divided into training set and validation set according to the ratio of 4:1.

[0049] The type number of the object is marked according to the type number in the object list. The object list contains all the types of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a system and method for visual detection of redundant objects based on deep learning in mechanical assembly. The detection system includes a workbench, an adjustable angle camera, a light source, a vision controller, etc. The vision controller processes and analyzes the images obtained from the camera to identify the objects in it, and then distinguish the assembly parts and redundant objects; the detection methods include The steps are as follows: obtain the multi-angle assembly area image, preprocess the image and input it into the trained target detection network model for feature extraction to predict the position and type of the object, then judge whether each object is redundant, and mark the redundant object position and call the police. The invention can assist manual detection of redundant objects in a specific area from multiple angles in real-time during the assembly process, has the advantages of high detection accuracy, strong real-time performance, flexible use, etc., can reduce the introduction of redundant objects in the assembly process, and enhance product reliability sex.

Description

technical field [0001] The invention belongs to the field of artificial intelligence, and in particular relates to a system and method for visual detection of redundant objects based on deep learning in mechanical assembly. Background technique [0002] Residues refer to all substances in the product that are entered from the outside or generated inside and have nothing to do with the specified state of the product. In the assembly process of large-scale equipment with high reliability and high safety, due to the complex structure of equipment and various production processes and assembly procedures, it is very easy to introduce redundant materials. For example, improper operation of workers may bring in objects such as screws, washers, hair strands, and rag residues; processes such as welding and machining may introduce redundant objects such as welding slag and metal chips. If these redundant substances are left in the equipment, it will leave serious safety hazards, whic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): B07C5/342B07C5/36B07C5/38G06K9/00G06K9/62G06N3/04G06N3/08
CPCB07C5/3422B07C5/361B07C5/38G06N3/08G06V20/10G06V2201/07G06V2201/12G06N3/045G06F18/23213G06F18/214
Inventor 王宣银汤继祥林天培
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products