Cross Reality Control Apparatus for Dynamic Work Instruction Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing work instruction systems using augmented reality struggle to maintain worker focus and efficiency due to content being displayed outside the field of view, dynamic movement speeds, and difficulties in handling complex shapes or operations.
Innovation Solution
A control apparatus that acquires work information, detects divergence from a model operation or state, and dynamically controls the reproduction of three-dimensional operation content using cross reality techniques, ensuring content remains within the worker's field of view and adjusts presentation speed accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If three-dimensional content is displayed dynamically to provide work instructions, then the completeness of work instruction content is improved, but the content may move outside the worker's field of view and be missed
Solution Approach 1:
The system continuously monitors the worker's head position and gaze direction through sensors, providing real-time feedback to dynamically adjust the display position of three-dimensional content. This ensures the content remains within the worker's field of view while maintaining complete work instruction information.
Solution Approach 2:
The display position and orientation of three-dimensional content are made dynamic, automatically adjusting in real-time according to the worker's head movement and gaze direction. This dynamic adaptation prevents content from moving outside the field of view while preserving comprehensive work instruction coverage.
2Ease of operation
If the field of view is moved to a position distant from the content to accommodate worker movement, then the worker's mobility is improved, but the content movement speed becomes too fast for the worker to follow
Solution Approach 1:
The content movement speed is dynamically adjusted based on the worker's head movement speed and gaze tracking. When the worker moves their head quickly, the content updates at a higher rate to maintain synchronization. When movement is slower, the content updates at a reduced rate, preventing information overload and ensuring the worker can comfortably follow the instructions.
Solution Approach 2:
The system changes multiple parameters including content position, orientation, and update frequency based on real-time analysis of worker head movement. This multi-parameter adaptation allows the system to balance worker mobility with content followability, adjusting the speed and position of content delivery to match the worker's pace.
3Device complexity
If two-dimensional images are used for work instructions, then the simplicity of the display is improved, but the ability to handle complicated shapes or operations is insufficient
Solution Approach 1:
The system transitions from two-dimensional flat images to three-dimensional content that can be displayed in spatial dimensions. This allows complex shapes, spatial relationships, and multi-step operations to be represented more effectively. The three-dimensional content maintains simplicity through optimized rendering while significantly enhancing the ability to handle complicated work tasks.
Solution Approach 2:
The system implements a hierarchical information presentation structure where three-dimensional content can be nested within larger spatial contexts. Complex operations are broken down into manageable three-dimensional components that can be displayed at different levels of detail, allowing the display to adapt to both simple and complex tasks without increasing overall system complexity.
4Loss of information
If content is displayed outside the field of view to provide comprehensive work instructions, then the completeness of instruction content is improved, but the worker may miss the content and require additional assistance
Solution Approach 1:
The system performs preliminary actions by predicting the worker's head movement trajectory and pre-positioning content in anticipation of where it will appear in the field of view. This prevents content from disappearing outside the field of view and eliminates the need for additional assistance to return content to the viewable area.
Solution Approach 2:
Real-time feedback from head tracking sensors continuously monitors worker position and adjusts content display accordingly. This closed-loop system ensures content remains within the field of view throughout the work instruction sequence, preventing information loss and eliminating the time required for content retrieval.
Data Source
AI summary
A control apparatus presents a three-dimensional operation to a worker using cross reality. The control apparatus is configured with a computer including a calculation device that performs a predetermined calculation process and a storage device that the calculation device is able to access. The calculation device includes an acquisition unit that acquires work information of work performed by the worker. The calculation device includes a calculation unit that performs calculation to present consecutive instruction content corresponding to the work performed by the worker to the worker. The calculation device includes an output unit that outputs content. The calculation unit includes a control unit that dynamically controls a display method for the consecutive instruction content according to a spatial divergence between the work information acquired by the acquisition unit and the consecutive instruction content.