Virtual Reality Control via Synchronized HMD and Touch Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality systems lack intuitive and seamless control methods for users to interact with virtual spaces and objects, limiting user experience and interaction efficiency.
Innovation Solution
An electronic system and method that utilizes a head-mounted display (HMD) and an electronic device to synchronize touch gestures and pen drawings, allowing users to control virtual reality spaces and objects through synchronized views and gestures, enabling moving, rotating, and resizing within preset boundaries, while tracking user hand movements and displaying virtual representations on the HMD.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch gestures are used to control virtual reality space and objects, then user interaction becomes more intuitive and efficient, but the system complexity increases due to synchronization requirements between actual and virtual displays
Solution Approach 1:
The patent creates a virtual copy of the actual display on the HMD that mirrors the electronic device's screen. This virtual display copy allows users to perform touch gestures in the virtual reality space that are automatically translated to control the actual display, enabling intuitive interaction without complex manual synchronization programming.
Solution Approach 2:
The patent introduces a gesture translation mechanism as an intermediary between the virtual display on HMD and the actual display. This intermediary automatically converts touch gestures performed on the virtual display into corresponding control commands for the actual display, reducing the complexity of direct synchronization control.
2Reliability
If virtual display on HMD is synchronized with actual display, then user experience becomes more immersive and seamless, but processing requirements and system resource consumption increase
Solution Approach 1:
The patent implements partial synchronization by selectively mirroring only the necessary display content to the HMD virtual display, rather than synchronizing every pixel change. This partial action approach maintains user experience consistency while reducing the processing overhead and resource consumption associated with full display synchronization.
3Adaptability or versatility
If hand tracking is implemented to display virtual hands and enable gesture input, then interaction capability is enhanced, but computational requirements and processing time increase
Solution Approach 1:
The patent performs preliminary hand tracking and virtual hand rendering in advance, preparing the gesture recognition data before actual interaction is needed. This preliminary action allows the system to have gesture processing ready, reducing the perceived processing time during actual user interaction while maintaining enhanced interaction capabilities.
Data Source
AI summary
Disclosed are an electronic system for performing control over a virtual reality space, an electronic device, and a method for operating same. The disclosed electronic system comprises: an electronic device which receives, as one or more touch gestures, control of a virtual reality space and/or an object within the virtual reality space and displays a first screen according to a corresponding first view frustum within the virtual reality space; and an HMD which is worn on the user's head and displays a second screen of the virtual reality space according to the head direction of the user at a time point corresponding to the second view frustum within the virtual reality space.