Mixed Reality Distance Visualization for Worker Hand Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Workers in production lines, such as vehicle assembly lines, struggle to intuitively recognize the distance between their hands and work objects when simulating tasks using mixed reality head-mounted displays, leading to inaccurate workload evaluation.
Innovation Solution
A video processing method that acquires a worker's position, posture, and line of sight, and displays a distance visualization portion on the display screen as a linear extension from a predetermined section of the worker's three-dimensional model to the work object, allowing intuitive recognition of the distance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If three-dimensional models of worker and work object are displayed on head mounted display device, then virtual work simulation is enabled, but worker cannot intuitively recognize distance between hand and work object
Solution Approach 1:
The patent applies color changes to the distance visualization portion to indicate distance between the worker's hand and work object. The distance visualization portion changes color based on distance measurements, allowing workers to intuitively recognize distance without requiring precise spatial judgment in the virtual environment. This resolves the contradiction by maintaining virtual simulation capability while adding intuitive distance feedback through color coding.
Solution Approach 2:
The patent introduces a distance visualization portion as an intermediary element between the worker's hand and the work object. This visual indicator acts as a mediator that provides distance information without altering the fundamental virtual simulation environment. The distance visualization portion bridges the gap between the virtual three-dimensional space and the worker's perception, enabling intuitive distance recognition while preserving the virtual work simulation capability.
2Measurement precision
If distance visualization portion is added to display, then distance recognition is improved, but display complexity increases
Solution Approach 1:
The patent segments the display information by separating the distance visualization portion from the main three-dimensional model display. The distance visualization is presented as a distinct, dedicated visual element rather than integrating it into the complex three-dimensional model rendering. This segmentation allows the distance information to be processed and displayed independently, reducing the computational complexity burden on the overall display system while maintaining accurate distance recognition.
Data Source
AI summary
A method is provided for processing a video to be displayed on a head mounted display device mounted on a worker performing virtual work. A position, posture, and line of sight of the worker are acquired, and a three-dimensional model of a work object on which the worker performs virtual work and a three-dimensional model of the worker are displayed on a display screen according to the acquired position, posture, and line of sight. A distance visualization portion is displayed which linearly extends from a predetermined section of the three-dimensional model of the worker and connects the predetermined section and the three-dimensional model of the work object, to visualize a distance between the predetermined section and the work object.