Recurrent Neural Network for Worker Proficiency Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In manufacturing sites, the inefficiency of manufacturing lines due to inexperienced workers is challenging to address, as existing methods rely on subjective human observation, which is time-consuming and prone to fluctuation based on observer experience and skill.

Innovation Solution

A detection system utilizing a recurrent neural network (RNN) with an LSTM structure, trained on time series data from workers with varying proficiencies, automatically identifies actions needing improvement by comparing activity responses to thresholds, eliminating the need for human observation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a human observer monitors worker actions to identify improvements, then detection accuracy can be maintained through human judgment, but the process becomes time-consuming and subjective

Engineering Contradiction:
Improvedetection accuracyVSAvoidobservation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the mechanical human observation system with an automated detection system using cameras, sensors, and AI algorithms. The system captures worker actions through imaging devices and sensor arrays, processes the data through neural networks trained on expert demonstrations, and automatically identifies improvement opportunities without human intervention, thereby eliminating time loss while maintaining detection accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates digital copies of expert worker actions through comprehensive data capture using multiple cameras and sensors. These copies are stored and used as training data for AI models, allowing the system to learn and replicate expert behavior patterns. The digital replicas enable automated comparison and detection of deviations from optimal performance without requiring actual human observers

Inventive Principle:
Principle #26Copying

2Device complexity

If human observers are used to detect worker actions, then the system remains simple to implement, but the results fluctuate based on observer subjectivity and experience

Engineering Contradiction:
Improvesystem simplicityVSAvoiddetection consistency
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system transforms the detection task from subjective human judgment to objective parameter-based analysis. Multiple sensors capture quantitative parameters such as position, velocity, acceleration, and temporal patterns of worker actions. AI algorithms process these parameters to identify deviations from optimal performance, ensuring consistent and reliable detection results that are independent of individual observer characteristics

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the unreliable human judgment mechanism with a standardized automated detection system. The system uses consistent algorithms and evaluation criteria that do not vary based on observer experience or subjectivity, thereby ensuring reliable and reproducible detection results across different workers and time periods

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If comprehensive worker action monitoring is implemented, then detection precision improves, but the system complexity and data processing requirements increase

Engineering Contradiction:
Improvedetection precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the complex task of worker action analysis into multiple independent components: separate imaging devices for different body parts, sensor arrays for specific measurements, and modular AI processing stages. Each component focuses on specific aspects of worker performance, allowing comprehensive monitoring while maintaining manageable system complexity through functional decomposition

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs multi-functional detection devices that can simultaneously capture multiple types of data. For example, imaging devices not only record worker positions but also detect body part orientations and movement patterns. This universal approach allows comprehensive monitoring with fewer devices, reducing overall system complexity while maintaining high detection precision

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11966836B2Detection system and detection method for using a neural network to detect a proficiency of a worker
Publication Date: 2024.04.23 KK TOSHIBA
  • US11966836B2 patent drawing
  • US11966836B2 patent drawing
  • US11966836B2 patent drawing

AI summary

According to one embodiment, a detection system includes an acquirer, a trainer, and a detector. The acquirer acquires first data, second data, and third data. The first data is based on an action of a first body part in a first work of a first worker having a first proficiency. The second data is based on an action of the first body part in the first work of a second worker having a second proficiency. The third data is based on an action of the first body part in the first work of a third worker. The trainer trains a recurrent neural network including a first output layer using the first data and the second data. The detector inputs the third data to the trained recurrent neural network and detects a response of the first neuron or the second neuron.