Mechanical assembly image segmentation method and equipment based on deep learning network

A deep learning network and image segmentation technology, which is applied in the fields of computer image recognition and intelligent manufacturing, can solve problems such as single color and texture information of mechanical parts, serious parts occlusion, and complex structure of mechanical products, so as to improve segmentation performance and reduce the number of parameters Effect

Active Publication Date: 2021-01-29
QINGDAO TECHNOLOGICAL UNIVERSITY
View PDF4 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] There are few researches on the application of semantic segmentation in the field of machinery, especially in the field of mechanical assembly. The main reasons are as follows: (1) The structure of mechanical products is complex, and the occlusion between parts is serious, which will lead to inaccurate segmentation of mechanical a

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mechanical assembly image segmentation method and equipment based on deep learning network
  • Mechanical assembly image segmentation method and equipment based on deep learning network
  • Mechanical assembly image segmentation method and equipment based on deep learning network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034] see figure 1 , a method for image segmentation of mechanical assemblies based on a deep learning network, comprising the following steps:

[0035] A lightweight semantic segmentation model of a mechanical assembly composed of an encoder network and a decoder network is constructed through a deep learning network; in this embodiment, the deep learning neural network is based on the Unet model.

[0036] To establish a mechanical assembly data set, first establish a plurality of three-dimensional models of mechanical assemblies through SolidWorks, and add color marks to each part in each of the three-dimensional models. Batch 3D rendering of the above 3D models to obtain the depth images and corresponding label images of the 3D models at different angles; select a depth image in the assembly stage from each 3D model, integrate it into a test set, and use the remaining depth images as a training set; The embodiment data set is composed of depth images of different assembly...

Embodiment 2

[0058] A mechanical assembly image segmentation device based on a deep learning network, including a memory, a processor, and a computer program stored in the memory and operable on the processor. described method.

Embodiment 3

[0060] A mechanical assembly image segmentation medium based on a deep learning network, on which a computer program is stored, and when the program is executed by a processor, the method as described in the first embodiment is implemented.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a mechanical assembly image segmentation method based on a deep learning network. The method comprises the following steps: constructing a mechanical assembly lightweight semantic segmentation model composed of an encoder network and a decoder network through the deep learning network; establishing a mechanical assembly data set; inputting a depth image in the mechanical assembly data set into an encoder network for feature extraction to obtain a feature map with high information quality; inputting the feature map with high information quality into a decoder network, recovering the size of the image and carrying out feature fusion to obtain a multi-dimensional segmentation map; updating parameters in the encoder network according to an error between the multi-dimensional segmentation image and the corresponding label image; iteratively executing the above steps by using the depth images in the training set until a preset number of training times is reached; outputting a lightweight semantic segmentation model of the mechanical assembly after testing; and carrying out image segmentation by utilizing the trained lightweight semantic segmentation model of themechanical assembly body to segment each part of the mechanical assembly body.

Description

technical field [0001] The invention relates to a method and equipment for image segmentation of a mechanical assembly based on a deep learning network, and belongs to the technical fields of computer image recognition and intelligent manufacturing. Background technique [0002] The current manufacturing industry is ushering in the production stage of mass customization, and the continuous change of product types will increase the difficulty of manual product assembly. In the assembly process of complex mechanical products, once the errors in the assembly process (such as wrong assembly sequence, missed assembly, wrong assembly, etc.) cannot be detected in time, the quality and assembly efficiency of mechanical products will be directly affected. Mechanical assembly image segmentation can accurately segment the outline and area of ​​the assembled parts of the mechanical assembly from the mechanical assembly image, obtain relevant information of the mechanical assembly, and f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/10G06T15/08G06T19/20G06N3/04G06N3/08
CPCG06T7/10G06T15/08G06T19/20G06N3/08G06N3/045Y02T10/40
Inventor 陈成军张春林李东年潘勇高玮赵正旭洪军
Owner QINGDAO TECHNOLOGICAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products