Wearable AR Control Panel for Intuitive Virtual Object Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices struggle to provide an enhanced user experience in augmented reality by effectively integrating virtual objects with real-world environments, particularly in wearable devices like AR glasses, where interactions with virtual objects are limited and user control is cumbersome.
Innovation Solution
A wearable device equipped with a camera, display, and processor that identifies virtual objects in a displaying area, overlays them with visual objects, and modifies these objects in response to user inputs, allowing for enhanced interaction and control within a mixed reality environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual objects are integrated with real-world environments in AR displays, then user experience is enhanced, but interaction control becomes cumbersome
Solution Approach 1:
A control panel is introduced as an intermediary interface between the user and virtual objects. The control panel displays visual objects representing virtual objects and receives user inputs, translating them into control signals. This mediator resolves the contradiction by providing an intuitive control mechanism while maintaining seamless virtual-real world integration.
Solution Approach 2:
The system implements feedback by displaying visual objects in the control panel that represent virtual objects in the AR environment. When users interact with these visual objects, the system provides real-time feedback by modifying the corresponding virtual objects in the augmented reality space, creating a closed-loop control system that enhances both integration and controllability.
2Ease of operation
If visual objects are displayed on a plane in external space overlapped with images from camera, then intuitive control is achieved, but device complexity increases
Solution Approach 1:
Visual objects that represent virtual objects are displayed as copies or representations on a control panel plane in the external space. These visual objects are overlapped with camera images to create an intuitive interface. The copying principle allows users to interact with simplified representations rather than directly manipulating complex virtual objects, reducing perceived device complexity while maintaining ease of operation.
Data Source
AI summary
A processor of a wearable device is configured to identify locations of one or more virtual objects in a displaying area based on an image including at least a portion of the displaying area. The processor is configured to display, on a plane disposed based on a location of the wearable device in an external space including the wearable device, the image superimposed on one or more visual objects representing the one or more virtual objects. The processor is configured to modify, in response to an input associated with the one or more visual objects, the one or more virtual objects. The present document is associated with a metaverse service for enhancing interconnection between a real object and a virtual object. For example, the metaverse service is provided through a network based on fifth generation (5G) and/or sixth generation (6G).