Process step correctness automatic detection method and system

An automatic detection and correctness technology, applied in character and pattern recognition, data processing applications, instruments, etc., can solve problems such as high cost and inability to detect process steps in real time, and achieve the effect of reducing labor costs and alleviating high costs.

Active Publication Date: 2020-08-07
盛景智能科技嘉兴有限公司
View PDF11 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In view of this, the object of the present invention is to provide a method and system for automatic detection of the correctness of process steps, to alleviate the technical problems of high cost and inability to detect process steps in real time in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Process step correctness automatic detection method and system
  • Process step correctness automatic detection method and system
  • Process step correctness automatic detection method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0021] figure 1 It is a flow chart of an automatic detection method for the correctness of process steps provided according to an embodiment of the present invention, and the method is applied to a server. Such as figure 1 As shown, the method specifically includes the following steps:

[0022] Step S102, perform semantic segmentation operation on the image to be detected based on the method of deep learning to obtain the target category of each pixel in the image to be detected; the image to be detected is an image frame in a video including the execution process of the process steps. Optionally, the pixel's target class includes any of the following: human body, work area, and background.

[0023] Optionally, the video of the execution process of the process steps is acquired through a dynamic image recording device. For example, video information of the process in which workers are performing process steps in a factory can be obtained through a monitor.

[0024] Optiona...

Embodiment 2

[0048] figure 2 It is a schematic diagram of an automatic detection system for process step correctness provided according to an embodiment of the present invention, and the system is applied to a server. Such as figure 2 As shown, the system includes: a semantic segmentation module 10 , a first determination module 20 , a recognition module 30 , a second determination module 40 and a judgment module 50 .

[0049] Specifically, the semantic segmentation module 10 is used to perform semantic segmentation operation on the image to be detected based on the method of deep learning, to obtain the target category of each pixel in the image to be detected; the image to be detected is an image frame in a video containing the process step execution process .

[0050] The first determining module 20 is configured to determine the human body region and the working region in the image to be detected based on the target category.

[0051] The identification module 30 is configured to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a process step correctness automatic detection method and system which are applied to a server, and the method comprises the steps: carrying out the semantic segmentation of a to-be-detected image based on a deep learning method, and obtaining the target type of each pixel in the to-be-detected image, wherein the to-be-detected image is an image frame in a video containing aprocess step execution process; determining a human body region and a working region in the to-be-detected image based on the target category; recognizing the human body area and the working area based on a deep learning method to obtain human body posture information and working task information respectively; determining process step information based on the human body posture information and the work task information; extracting a target feature vector of the process step information based on a deep learning method, and judging whether the process step is correctly executed or not based onthe target feature vector. The technical problems that in the prior art, the cost is high, and the process steps cannot be detected in real time are solved.

Description

technical field [0001] The invention relates to the technical field of artificial intelligence, in particular to an automatic detection method and system for correctness of process steps. Background technique [0002] In the actual production process, whether the process steps are executed correctly has a decisive impact on production quality and production safety. Incorrect process execution steps will not only affect the quality of the product, but also cause major safety accidents in many cases. Therefore, How to check whether the execution sequence of workers' process steps is correct has always been the focus and pain point of factory management. At present, the main schemes for checking the correctness of the process steps are mainly realized through manual spot checks or workers’ own experience checks. This has the following technical problems: on the one hand, the cost is relatively high; It is difficult to detect errors in process steps in time. Contents of the i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/32G06K9/34G06Q10/06
CPCG06Q10/0633G06V40/23G06V20/46G06V10/25G06V10/267
Inventor 曹恩华
Owner 盛景智能科技嘉兴有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap