Interactive intelligent disassembling and assembling system based on deep learning

A deep learning and assembly system technology, applied in manufacturing computing systems, neural learning methods, character and pattern recognition, etc., can solve problems such as unusable disassembly and assembly systems, inconvenient manual operations for operators, dynamic assembly demonstrations, etc.

Pending Publication Date: 2021-08-17
航天智造(上海)科技有限责任公司
View PDF8 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to solve the disadvantages that the disassembly and assembly system in the prior art cannot use dynamic combination assembly for demonstration, and the operator is not convenient for manual operation, and proposes an interactive intelligent disassembly and assembly based on deep learning system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Interactive intelligent disassembling and assembling system based on deep learning
  • Interactive intelligent disassembling and assembling system based on deep learning
  • Interactive intelligent disassembling and assembling system based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments represent only some, not all, embodiments of the present invention.

[0024] refer to Figure 1-5 , an interactive intelligent disassembly and assembly system based on deep learning. The system includes a face detection module, a face alignment module, a face representation module and a face matching module. The deep learning system adopts a two-stage detection model, and the two-stage detection model includes R-CNN, FastR-CNN, FasterR-CNN and Mask-RCNN.

[0025] In the present invention, the gesture recognition system includes an end-to-end training module.

[0026] In the present invention, the image affine transformation system includes a projective transformation module.

[0027] In the present invention, the human face de...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of disassembling and assembling systems, particularly relates to an interactive intelligent disassembling and assembling system based on deep learning. For solving the problems that in the prior art, a disassembling and assembling system cannot use dynamic combined assembling for demonstration, and manual operation of an operator is inconvenient, a technical scheme is provided, wherein the system comprises an equipment rack; a face recognition system, a deep learning system, a gesture recognition system and an image affine transformation system are sequentially arranged on the equipment rack; the face recognition system comprises a face detection module, a face alignment module, a face representation module and a face matching module; and the deep learning system comprises a two-stage detection model and a single-stage detection model. According to the invention, gestures of people of various skin colors and wearing of gloves with different colors can be identified, the gestures are connected with mouse operation, an operator is prompted to take corresponding tools or parts by illuminating a tool or part material box needing to be used, and the tools are monitored in real time.

Description

technical field [0001] The invention relates to the technical field of disassembly and assembly systems, in particular to an interactive intelligent disassembly and assembly system based on deep learning. Background technique [0002] The traditional assembly / disassembly instruction manual uses a combination of pictures and text to express the operation process and prompt the main points of operation, and finally print it into a paper file and provide it to the on-site operators. The traditional instruction manual has the following disadvantages: when the operator is working, it is impossible to look up the information due to the fact that the operator is holding the parts with both hands or the hands are oily; some parts require dynamic assembly and cannot be expressed intuitively with static pictures or text, which increases the training time for operators; There will be a variety of instruction manuals for small batches and multiple varieties of workpieces, requiring a la...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04G06N3/08G06T3/00G06T17/00G06Q30/00G06Q50/04
CPCG06T17/00G06T3/0006G06N3/08G06Q30/018G06Q50/04G06V40/28G06V40/168G06V40/172G06N3/045Y02P90/30
Inventor 陈曾沁何志成温培刚张韶越尚继辉程俊华陈小虎
Owner 航天智造(上海)科技有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products