Virtual Mechanical Controls for Realistic VR Machine Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality systems for industrial automation lack flexibility and realism in human-machine interaction, requiring significant engineering effort and adjustments when real operating means change, with limited interaction options and inefficient computing load distribution.
Innovation Solution
A method and arrangement that separate machine simulation and visualization, using a generic treatment of mechanical operating elements through physical mediation and simulation, where input information from virtual interactions is transmitted to simulate movement and switching states, maintaining consistency and flexibility across different immersive environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If interaction routines are hard-coded into the virtual reality system, then the system can detect and respond to user inputs, but the engineering effort increases and flexibility decreases when real control devices change
Solution Approach 1:
The patent introduces a simulation environment as an intermediary layer between the virtual reality system and the control device. This simulation environment models the physical behavior of control devices and translates virtual interactions into realistic physical responses, allowing the VR system to remain flexible while maintaining reliable interaction detection through the mediating simulation layer
Solution Approach 2:
The system is segmented into distinct functional layers: the virtual reality system handles visualization and user interaction detection, while a separate simulation environment handles physical behavior modeling. This segmentation allows each layer to be independently modified without affecting the other, improving both flexibility and reliability
2Ease of operation
If the virtual reality system reimplements the logical connection of the human-machine interface, then interaction can be detected, but the machine design aspect is implemented twice increasing engineering effort
Solution Approach 1:
Instead of reimplementing the logical connection of the human-machine interface in the VR system, the patent creates a digital copy of the control device's physical behavior through simulation. The simulation environment copies the mechanical properties and response characteristics of the real device, allowing the VR system to interact with this copy rather than reimplementing the entire interface logic
Solution Approach 2:
The simulation environment serves multiple functions: it models physical behavior, translates virtual inputs to physical responses, and provides a universal interface that works with different control devices. This multi-functionality eliminates the need for separate implementation of interface logic in the VR system
3Ease of manufacture
If commercially implemented industrial virtual reality systems use predefined interaction routines, then implementation is simplified, but interaction possibilities are very limited
Solution Approach 1:
The patent transforms the static, predefined interaction routines into a dynamic simulation-based system. Instead of fixed interaction patterns, the simulation environment dynamically models the physical behavior of control devices, allowing for realistic and varied interaction possibilities while maintaining ease of implementation through the standardized simulation interface
Data Source
AI summary
The invention relates to a method and an arrangement for immersive human-machine interaction (NI) with a virtual mechanical control device of an industrial automation arrangement in a virtual reality (IU), wherein input information is transmitted to a component (V-PLC) of the industrial automation arrangement through the interaction (NI) with the control device. The mechanical control device is modeled in a simulation device (STM) for rigid body simulation, wherein the mechanical control device is represented in the virtual reality (IU), and wherein the virtual reality (IU) detects an interaction (NI) with the represented control device. From first parameters of the detected virtual interaction (NI), second parameters (F) are calculated via a simulated physical action on the control device, and the second parameters (F) are transmitted to the simulation device (STM).The simulation device (STM) uses the second parameters (F) via the modeled operating device to simulate a movement (X) of at least a part of the operating device, determining whether the simulated movement (X) results in a change of the operating device's switching state, and, at least in the case of a change of switching state, reporting the switching state or the change in switching state as input information to the component (V-PLC). This ensures a strict separation between machine simulation and machine visualization, capturing and representing the virtual operation of a mechanical operating device in a realistic manner.