Manual assembly visual detection error prevention method and system

A manual assembly and visual inspection technology, applied in image data processing, instruments, calculations, etc., can solve the problems of low discrimination between operators and fine operation actions, and cannot cover complex assembly operations, so as to improve the one-time completion rate and save The time for self-inspection and review of process manuals, and the effect of improving assembly efficiency

Active Publication Date: 2017-03-22
SHANGHAI JIAO TONG UNIV +1
View PDF4 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention aims at the characteristics that most of the existing technologies need to rely on the identification of assembly in place to prevent errors or to prevent errors through video recording, resulting in the inability to give feedback to the assembly personnel in time during the assembly process, requiring rework time, or requiring the actual operating angle of view to conform to the sample as much as possible The angle of view during video collection has a low degree of discrimination between different operators and fine operation actions, and it cannot cover the defects of complex assembly operations with two-handed cooperation. A method and system for manual assembly visual inspection and error prevention are proposed, which can significantly improve the overall assembly process. Efficiency and first-time completion rate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Manual assembly visual detection error prevention method and system
  • Manual assembly visual detection error prevention method and system
  • Manual assembly visual detection error prevention method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] Such as figure 1 As shown, the visual error prevention system for tooling and assembly in this embodiment includes: a head-mounted video capture device 10, a fixed video capture device 6, lighting equipment 4, a retrieving box 9, a background plate 7, a material rack 12, and a head-mounted optical aid The display device 11, the interactive display device 5 and the control module 8, wherein: the head-mounted video acquisition device 10 collects the first-view image of the manual assembly and transmits it to the control module 8; the fixed video acquisition device 6 collects the parts after the assembler picks up the parts The image is transmitted to the control module 8; the head-mounted optical auxiliary display device 11 outputs and displays assembly process guidance information to the assembly operator, and is respectively connected with the head-mounted video acquisition device 10 and the control module 8; the interactive display device 5 and the control module 8 pass...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a manual assembly visual detection error prevention method and system. Through associating the assembly process guide information for assembly simulation and assembly state identification information extracted from a sample video according to an operation sequence, an error prevention early alarm information model is generated, and equipment and a working space are calibrated in the model. Then the assembly schedule and assembly state of manual assembly are monitored, and the assembly behavior recognition, the assembly in-place recognition and assembly part recognition are carried out, and finally the assembly correctness is judged, error prevention information comprising a rendering synthesis image and assembly process guide information and assembly state identification information are exported from the error prevention early alarm information model if the assembly is wrong, and the multi-channel synchronous display is carried out in a plurality of display output devices. According to the method and the system, the error in a manual assembly process can be prevented, error prevention guide information is provided for manual assembly personnel in a mode of visual feedback, the times of self inspection and manual inspection are saved, and the assembly efficiency and one-time completion rate are improved.

Description

technical field [0001] The invention relates to a technology in the field of intelligent manufacturing, in particular to a manual assembly visual detection error prevention method and system. Background technique [0002] Assembly error prevention is to replace manual repetitive labor through the application of error prevention technology and devices, and eliminate defects caused by difficulty in maintaining a high degree of attention and memory. [0003] Visual gesture recognition refers to predicting or judging human interaction intentions by extracting gesture image features. For unconscious natural operation gestures, the gesture image features are expressed and processed by the method of statistical model recognition, and effective gesture image features and recognition conditions are obtained. Contents of the invention [0004] The present invention aims at the characteristics that most of the existing technologies need to rely on the identification of assembly in p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/00
CPCG06T7/0006G06T2207/10016
Inventor 尹旭悦范秀敏王磊金小舒冯立杰张小龙汪嘉杰刘睿王强
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products