Production operation behavior identification method, device, equipment and system based on structured double-flow convolutional neural network and storage medium

A convolutional neural network and identification method technology, applied in the field of production operation behavior identification method, device, system and storage medium, equipment, can solve the problems of complexity and particularity, can not meet the production operation behavior identification accuracy and efficiency and other problems , to achieve the effect of enhanced detection

Active Publication Date: 2019-09-10
杭州智尚云科信息技术有限公司
View PDF4 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] However, the production operation behavior recognition technology has its complexity and particularity, and the existing image processing scheme cannot meet the accuracy and efficiency of production operation behavior recognition.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Production operation behavior identification method, device, equipment and system based on structured double-flow convolutional neural network and storage medium
  • Production operation behavior identification method, device, equipment and system based on structured double-flow convolutional neural network and storage medium
  • Production operation behavior identification method, device, equipment and system based on structured double-flow convolutional neural network and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0039] In order to better describe and illustrate the embodiments of the application, reference may be made to one or more drawings, but additional details or examples used to describe the drawings should not be regarded as an invention of the application, the presently described implementation limitations on the scope of any of the examples or preferred modes.

[0040] It should be noted that when a component is said to be "connected" to another component, it may be directly connec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a production operation behavior identification method, device, equipment and system based on a structured double-flow convolutional neural network and a storage medium, and themethod comprises the following steps: obtaining a monitoring video of a production environment, and decomposing the monitoring video into an image frame sequence and an optical flow sequence; inputting the image frame sequence and the optical flow sequence into a structured double-flow convolutional neural network to obtain an action category and timestamp information of each frame of image; introducing an attention mechanism into the structured double-flow convolutional neural network; and according to the action category and the timestamp information, obtaining a production action instancethrough calculation. According to the production operation behavior identification method provided by the invention, the production operation behavior in the video can be rapidly and accurately identified, and the intelligent manufacturing requirement is met.

Description

technical field [0001] The present application relates to the technical field of video image analysis, in particular to a production operation behavior recognition method, device, equipment, system and storage medium based on a structured two-stream convolutional neural network. Background technique [0002] Computer vision technology is used in many research fields, including person recognition, image reconstruction and action recognition. For the surveillance video analysis of large factories, many works apply computer vision technology framework to production operation behavior recognition engineering to ensure employee safety, production scheduling, and improve global equipment efficiency, etc. [0003] At present, intelligent monitoring generates tens of thousands of valuable video data every day. In order to make full use of these video data, it is necessary to design a production operation behavior recognition that can automatically extract features and patterns from ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/20G06V20/41G06N3/045
Inventor 胡海洋朱相玲
Owner 杭州智尚云科信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products