Wearable Mixed Reality System for Operator Mishandling Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to effectively reduce operator mishandling in various work environments, leading to potential workplace incidents, as human-factors engineering is difficult to implement across all production devices, and standard training methods do not adequately prepare employees for unexpected situations.
Innovation Solution
A wearable electronic device system combining a head-mounted mixed reality headset, wrist-mounted smart devices, and a camera with a judgment module that uses data fusion to monitor and forecast abnormal body poses against standard operating procedures, providing real-time warnings to prevent mishandling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If standard employee training with SOP documents and operating manuals is provided, then employees can perform jobs and operate machines, but employees still show mishandling when unexpected situations occur
Solution Approach 1:
The system continuously monitors employee operations through cameras and sensors, compares them against SOP data, and provides real-time feedback through the wearable device when abnormal activities are detected, enabling employees to correct mistakes immediately rather than through delayed training
Solution Approach 2:
The system pre-loads standard operating procedures and safety data into the wearable device before operations begin, allowing employees to access relevant SOP information instantly during unexpected situations without needing to search through physical manuals
2Reliability
If human-factors engineering is implemented by developing human-machine systems for production machines, then operator mishandling is reduced, but it is very difficult and impossible to develop or redesign each production-relative device
Solution Approach 1:
The system uses a universal wearable electronic device that can be worn by any operator across different workstations and production lines, eliminating the need to modify each individual machine while still providing personalized safety monitoring and guidance
Solution Approach 2:
The wearable electronic device acts as an intermediary between the operator and the production machines, providing safety monitoring and guidance without requiring direct modification of the machines themselves, thus simplifying implementation
3Reliability
If real-time monitoring and body pose forecasting is implemented, then workplace incidents are prevented, but system complexity and data processing requirements increase
Solution Approach 1:
The system divides monitoring functions across multiple components: cameras capture images, the wearable device captures body pose data and head motion, and the judgment module processes this segmented information separately before integrating it for comprehensive safety assessment
Solution Approach 2:
The system focuses monitoring on critical body parts and poses that are most relevant to safety, rather than attempting to monitor every movement, thus reducing data processing complexity while maintaining effective safety monitoring
Data Source
AI summary
A system for recognizing abnormal activity of human body using wearable electronic device and mixed reality technology, includes a first wearable electronic device, a plurality of second wearable electronic devices, at least one camera, and a judgement module. The system is suitable to be applied in any type of work environment, so as to monitor and determine whether a user (i.e., an operator or an employee) exhibits abnormal activities by referring a document of standard operating procedures (SOP), an operating manual and a document of safety operation standard (SOS), to reduce a rate of user mishandling, thereby achieving the enhancement of work efficiency and productivity.