Mixed-Reality Touch Interface for Vehicle Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current human-machine interfaces (HMIs) lack seamless integration of real-world and mixed-reality environments, limiting intuitive interaction and control over vehicle systems through touch devices.
Innovation Solution
A system comprising a mixed-reality device and a touch device that includes sensors, mapping devices, simulators, and displays to detect, calibrate, and render human-touch-device interactions, allowing users to interact with a mixed-reality environment using touch inputs, without the need for virtual reality controllers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional human-machine interfaces are used in vehicles, then the system structure is simple and easy to manufacture, but the integration between real-world and mixed-reality environments is insufficient, limiting intuitive interaction
Solution Approach 1:
The patent merges the touch device interface with the mixed-reality display by projecting virtual interface elements directly onto the physical touchscreen surface. This integration allows users to interact with virtual controls while maintaining tactile feedback from the physical touch surface, seamlessly combining real-world and mixed-reality environments into a unified interaction system
Solution Approach 2:
The touch device serves as an intermediary between the physical vehicle systems and the virtual mixed-reality interface. It detects physical touch inputs and translates them into interactions with virtual elements in the mixed-reality environment, enabling intuitive control while bridging the gap between tactile reality and visual virtuality
2Ease of operation
If virtual reality controllers are required for interaction, then the control precision is improved, but the ease of operation deteriorates and additional equipment is needed
Solution Approach 1:
The touch device itself serves dual purposes: it functions as both the physical interaction surface and the display medium for virtual interface elements. Users interact directly with the familiar touchscreen interface, which now presents virtual controls overlaid on the physical surface, eliminating the need for separate VR controllers while maintaining intuitive operation
Solution Approach 2:
The touch device is enhanced to perform multiple functions simultaneously: it serves as the physical input interface, the display medium for virtual elements, and the communication bridge between the user and the mixed-reality environment. This multi-functionality eliminates the need for additional specialized controllers
Data Source
AI summary
A system for mixed-reality interaction with a touch device may include a mixed-reality device including a sensor, a mapping device, a simulator, and a display and a touch device including an input device. The input device of the touch device and the sensor of the mixed-reality device may detect a human-touch-device interaction. The mapping device may calibrate, correlate, and map the human-touch-device interaction from a real-world environment to a mixed-reality environment. The input device of the touch device may receive an input based on the human-touch-device interaction. The simulator of the mixed-reality device may render a view of the human-touch-device interaction within the mixed-reality environment and a view of an action within the mixed-reality environment corresponding to the input determined based on the human-touch-device interaction. The display of the mixed-reality device may display the rendered views.