Hand Image Work-State Detection for Manufacturing Stoppages

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies, such as those described in PTL 1 and PTL 2, are inadequate for accurately determining work stoppages in manufacturing processes, particularly when human work is involved, as they rely on device log information and cannot accurately assess standby times or require precise target value settings.

Innovation Solution

An assistance system that includes detection means for identifying hands in images of work areas, determination means to assess work states based on hand detection, and output means to provide information on work states, enabling accurate identification of work stoppages.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If device log information is used to determine work stoppages, then automation is improved, but measurement precision deteriorates for human work

Engineering Contradiction:
ImproveautomationVSAvoidmeasurement precision
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The patent replaces device log-based detection with image processing technology to detect hand presence and determine work stoppages. The imaging device captures images of the work area, and the determination unit analyzes these images to detect whether the worker's hand is present, thereby substituting mechanical/log-based detection with optical/image-based detection to achieve both automation and precision for human work.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If target work time values are used to estimate bottlenecks, then productivity analysis is improved, but measurement precision deteriorates without accurate target values

Engineering Contradiction:
Improveproductivity analysisVSAvoidmeasurement precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system uses actual image data from the work area to automatically determine work stoppages and calculate standby times without requiring pre-set target work time values. The determination unit analyzes hand presence in real-time images to self-determine work states, eliminating the need for external target value inputs and achieving both productivity analysis and measurement precision simultaneously.

Inventive Principle:
Principle #25Self-service

3Device complexity

If manual reports and alarms are used to notify work stoppages, then device complexity is reduced, but loss of information increases

Engineering Contradiction:
Improvedevice complexityVSAvoidloss of information
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The system implements automatic feedback by continuously capturing images of the work area and analyzing hand presence to determine work stoppages. The determination unit processes image data in real-time and generates work state information automatically, creating a closed-loop feedback system that eliminates information loss while maintaining simple device architecture through automated image-based detection.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20230394885A1Assistance system, assistance method, and storage medium
Publication Date: 2023.12.07 NEC PLATFROMS LTD
  • US20230394885A1 patent drawing
  • US20230394885A1 patent drawing
  • US20230394885A1 patent drawing

AI summary

An assistance system according to an aspect of the present disclosure includes: at least one memory storing a set of instructions; and at least one processor configured to execute the set of instructions to: detect a hand from an image obtained by imaging a work area; determine a work state based on a hand detection result; and outputting output information indicating the work state.