Industrial Machinery MR Gesture Control With Safe Operating Range
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mixed reality technologies for industrial machinery operations do not allow for intuitive and safe operation, as they require monitoring of both the machine's state and operator panels, and fail to ensure safety by synchronizing real and virtual spaces effectively.
Innovation Solution
An operation system that includes an information acquisition unit, machine identification unit, model projection unit, distance-direction calculation unit, gesture observation unit, instruction determination unit, and operation instruction unit, which projects a 3D model of the industrial machine into a virtual space, allowing users to provide instructions through gestures while ensuring safety by determining valid operation ranges and conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If mixed reality technology is applied to project a 3D model of the industrial machine in a virtual space, then the intuitiveness of operation is improved, but the safety of operation cannot be secured
Solution Approach 1:
The system continuously monitors the user's position and gesture in real-time, providing feedback by displaying the virtual model that moves synchronously with the real machine. This allows the user to intuitively understand machine state while maintaining safety through continuous spatial awareness
Solution Approach 2:
The virtual model acts as an intermediary between the user and the real industrial machine. It provides intuitive visual feedback about machine state and position without requiring the user to directly interact with physical controls, thereby improving intuitiveness while maintaining safety
2Measurement precision
If the operator monitors the operator's board or panel to operate the industrial machine, then the operation control is precise, but the operator cannot simultaneously watch the state of the industrial machine
Solution Approach 1:
The system merges the operator's board information with the real-world view by projecting virtual information overlays onto the physical machine. This allows the operator to see both machine state data and physical machine condition simultaneously, eliminating the need to switch between panel and machine view
Solution Approach 2:
The system adds a virtual dimension to the physical operation space by projecting 3D models and information overlays in the user's field of view. This allows comprehensive machine state monitoring without blocking the view of the actual machine, providing information in an additional spatial dimension
Data Source
AI summary
An operation system for industrial machinery comprises: an information acquisition unit which acquires machine identification information corresponding to an industrial machine; a machine identification unit which identifies the industrial machine on the basis of the acquired machine identification information; a model projection unit which projects a model corresponding to the identified industrial machine into a virtual space; a distance/direction calculation unit which calculates the distance and direction, of a user observing the model, with respect to the projected model; a gesture observation unit which observes the gesture of the user as an instruction from the user to the identified industrial machine; an instruction determination unit which determines whether or not a user can give an instruction; and an operation instruction unit which operates the identified industrial machine on the basis of the observed gesture of the user, when the determination result is positive.