AR Wearable Negligence Warning via Virtual Wrapping Geometry

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In the manufacturing industry, human negligence can lead to errors in operating instrument interfaces, resulting in production losses and safety risks due to operator fatigue, variability in following standard procedures, and inability to reliably monitor operator behavior.

Innovation Solution

A human negligence warning method using augmented reality (AR) and hand gesture tracking, which integrates spatial position calculations and virtual wrapping geometry elements to predict operator intentions and provide real-time feedback warnings, preventing incorrect operations by disabling buttons or outputting warnings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional training and operation manuals are used to guide operators, then operators can complete tasks through education and training, but the method is highly affected by human factors such as ability, experience, and mental state, making behavior monitoring unreliable

Engineering Contradiction:
Improveoperator behavior monitoring reliabilityVSAvoidmonitoring system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces manual monitoring methods with an automated computer vision system that uses image processing and gesture recognition algorithms to detect hand movements and predict operational intentions. This substitution of mechanical/visual monitoring with automated image analysis resolves the contradiction by providing reliable, objective monitoring without requiring complex human oversight mechanisms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-monitoring by having the operator's own hand gestures and movements automatically detected and analyzed by the vision system. The operator's natural actions serve as the input data for the monitoring process, eliminating the need for separate monitoring devices or procedures while maintaining high reliability.

Inventive Principle:
Principle #25Self-service

2Reliability

If AR and hand gesture tracking are integrated to track finger position and predict operator intention, then incorrect operations can be prevented in advance, but the device complexity and processing requirements increase

Engineering Contradiction:
Improveerror prevention capabilityVSAvoidAR and gesture tracking system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary detection of hand gestures and spatial position calculations before the operator actually contacts the instrument interface. By predicting operational intentions in advance through gesture recognition and spatial analysis, the system can issue warnings or prevent incorrect operations before they occur, resolving the contradiction by shifting the intervention point to an earlier stage.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces virtual wrapping geometry elements as an intermediary layer between the physical instrument interface and the operator's hand. These virtual elements act as a mediator that enables the system to detect intended operations without requiring direct contact, allowing for prediction and warning while maintaining a relatively simple physical interface.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If virtual wrapping geometry elements are used to wrap physical operation elements, then hand touch detection becomes more accurate, but the computational load for spatial position calculations increases

Engineering Contradiction:
Improvehand touch detection precisionVSAvoidcomputational energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system creates virtual copies (wrapping geometry elements) of the physical operation elements in the augmented reality space. These virtual copies serve as simplified representations that can be computationally processed to detect hand positions and gestures with high precision. The copying approach allows for accurate detection while managing computational load by working with geometric models rather than complex physical simulations.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11226679B1Human negligence warning method based on augmented reality
Publication Date: 2022.01.18 NATIONAL TSING HUA UNIVERSITY
  • US11226679B1 patent drawing
  • US11226679B1 patent drawing
  • US11226679B1 patent drawing

AI summary

A human negligence warning method based on augmented reality includes steps of: using a smart wearable device to photograph multiple physical operation elements of an electronic apparatus to obtain interface depth data; performing spatial position calculations according to the interface depth data, to set corresponding wrapping geometry elements between the physical operation elements and the smart wearable device to wrap the physical operation elements, respectively; photograph a hand of a wearer wearing the smart wearable device to obtain a gesture and a spatial position of the hand; and judging whether the hand touches one of the wrapping geometry elements according to the gesture and the spatial position, and further judging whether a corresponding procedure to be initiated by the physical operation element is correct if yes, If the corresponding procedure is not correct, then an warning operation is performed to avoid human negligence.