VR/AR Interaction Interfaces for Accurate Virtual Screen Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR/AR devices face challenges in meeting efficient and complex interaction requirements, such as graphical interface positioning and text input, in scenarios like mobile office, entertainment, and gaming, due to limitations in interaction methods like gesture, head movement, and voice recognition, which result in low accuracy and high power consumption.
Innovation Solution
A device interaction method where a VR/AR device is connected to an electronic device, generating multiple interaction interfaces on the display area of the electronic device, allowing users to input operations like positioning, dragging, zooming, and character entering through virtual touchpad, keyboard, and joypad interfaces, with automatic or manual configuration based on display size and user preference.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If simple interaction methods (gesture, head movement, voice) are used in VR/AR devices, then device complexity is reduced, but interaction efficiency and accuracy deteriorate
Solution Approach 1:
The patent introduces an electronic device as an intermediary between the user and the VR/AR device. This intermediary device provides a display area showing multiple interaction interfaces (virtual touchpad, keyboard, joypad) that enable complex interactions without requiring the VR/AR device itself to be complex. The intermediary translates simple user inputs into precise control commands for the VR/AR device, resolving the contradiction between simplicity and efficiency.
Solution Approach 2:
The patent moves the interaction interface from the VR/AR device's limited input mechanisms to a separate electronic device's display area. This dimensional shift allows the interaction system to leverage the electronic device's superior display and input capabilities while keeping the VR/AR device simple. The interaction interfaces are rendered in a different spatial dimension (the electronic device's screen) rather than within the VR/AR device itself.
2Productivity
If multiple interaction interfaces are generated and displayed on the electronic device, then interaction efficiency is improved, but device complexity increases
Solution Approach 1:
The patent segments the interaction system into distinct functional components: the electronic device handles interface generation and display, while the VR/AR device handles execution. Multiple interaction interfaces (virtual touchpad, keyboard, joypad) are generated as separate, independent interface objects within the display area. This segmentation allows each interface type to be optimized independently while maintaining overall system manageability.
Solution Approach 2:
The patent creates virtual copies of traditional interaction interfaces (touchpad, keyboard, joypad) within the electronic device's display area. These virtual interfaces replicate the functionality of physical devices without requiring physical hardware. The virtual touchpad interface, virtual keyboard interface, and virtual joypad interface are software-based copies that provide familiar interaction paradigms in a digital environment, reducing the need for users to adapt to entirely new interaction methods.
3Weight of moving object
If virtual interaction interfaces are used instead of additional hardware, then portability is maintained, but interaction precision deteriorates
Solution Approach 1:
The patent replaces physical mechanical interaction devices (external keyboards, mice, game controllers) with virtual software-based interfaces displayed on the electronic device's screen. The virtual touchpad, keyboard, and joypad interfaces eliminate the need for additional physical hardware while providing precise interaction control. The electronic device's touchscreen and processing capabilities substitute for mechanical input devices, maintaining portability without sacrificing precision.
Data Source
AI summary
A device interaction method, an electronic device, and an interaction system are provided. The device interaction method includes: After detecting that a VR/AR device connected to an electronic device enters a predetermined operating mode, the electronic device generates at least two interaction interfaces used by the VR/AR device to perform an interaction operation, and displays at least one of the interaction interfaces in a display area of the electronic device.