Mixed Reality Device Hand Recognition Fastening Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a need for technology that can prevent inappropriate tasks during fastening operations using mixed reality devices, as existing methods are inefficient and prone to errors.
Innovation Solution
A mixed reality device equipped with an imaging part and a processing part that recognizes a worker's hand performing a fastening task and determines the appropriateness of the task based on the distance between the fastening location and the hand holding the tool.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual monitoring of fastening tasks is used, then operational flexibility is maintained, but task accuracy and reliability deteriorate due to human error
Solution Approach 1:
The patent replaces manual visual monitoring and judgment with an automated image recognition system using cameras and AI processing. The system captures images of the fastening task, automatically identifies the fastening location and tool, measures distances, and determines task appropriateness without human intervention, thereby improving reliability while maintaining manageable complexity through software-based solutions.
Solution Approach 2:
The system enables self-monitoring and self-validation of fastening tasks. The image recognition system automatically detects whether the fastening operation is appropriate by comparing the distance between the fastening location and tool against predefined standards, allowing the system to self-evaluate task quality without requiring external supervision or complex manual checking procedures.
2Measurement precision
If automated image recognition is implemented, then task monitoring accuracy improves, but processing time and computational load increase
Solution Approach 1:
The system performs preliminary identification and classification of fastening locations, tools, and task types before detailed measurement and evaluation. By pre-processing images to identify key elements and their categories, the system reduces the computational complexity of subsequent distance measurements and appropriateness judgments, thereby improving measurement precision while minimizing additional processing time.
Solution Approach 2:
The image processing is divided into distinct segments: image acquisition, fastening location identification, tool identification, distance measurement, and appropriateness determination. This segmentation allows each processing stage to be optimized independently and enables parallel processing where possible, reducing overall processing time while maintaining high measurement precision through focused computational efforts.
3Reliability
If comprehensive task verification is performed, then task appropriateness determination improves, but operational efficiency deteriorates due to increased checking requirements
Solution Approach 1:
The system provides immediate feedback on fastening task appropriateness by automatically comparing the measured distance between the fastening location and tool against predefined standards. This real-time feedback mechanism allows operators to correct inappropriate tasks instantly without requiring multiple manual inspection cycles, thereby maintaining high verification accuracy while preserving operational efficiency through single-pass automated evaluation.
Data Source
AI summary
According to one embodiment, a mixed reality device includes an imaging part and a processing part. The imaging part is configured to acquire an image. The processing part is configured to recognize, from the image, a hand of a worker performing a fastening task. The processing part is further configured to determine whether the fastening task is appropriate based on a first distance between a first position corresponding to a fastening location of a screw and a second position of the hand holding a first tool.