AR Wearable Control Handoff for Precise Virtual Object Manipulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) devices face challenges in precise manipulation of virtual objects due to their inability to be manipulated by touch, leading to decreased accuracy and user fatigue when controlling small or distant virtual objects.
Innovation Solution
An AR device controlled by an external wearable device, where the wearable device is recognized and provided with control authority over virtual objects, allowing it to change data values and update functions through short-range communication, enhancing precision and user convenience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If vision-based hand tracking technology is used to control virtual objects in AR devices, then the device can be manipulated without touch, but the accuracy of control decreases when manipulating small or distant virtual objects
Solution Approach 1:
The patent introduces an external wearable device as an intermediary between the user and the AR virtual objects. The wearable device (e.g., smartwatch) serves as a mediator that receives user inputs and transmits control commands to the AR device, enabling precise control of small or distant virtual objects without requiring direct visual tracking or touch interaction with the AR interface itself.
Solution Approach 2:
The control function is segmented into two separate devices: the AR device displays and renders virtual objects, while the external wearable device handles the precise input control. This segmentation allows each device to specialize in its strength - the AR device in visualization and the wearable device in precise input measurement and control.
2Adaptability or versatility
If the virtual object is placed at a long distance from the user's hand for AR display, then the AR service can be provided, but the user needs large movements to manipulate the object which decreases manipulation accuracy
Solution Approach 1:
The wearable device acts as an intermediary that bridges the gap between the user's physical movements and the virtual object manipulation. It captures precise input data (such as button presses, dial rotations, or touchscreen inputs) and transmits these commands to the AR device, eliminating the need for large hand movements to interact with distant virtual objects.
3Measurement precision
If precise manipulation is required for virtual objects, then control accuracy must be high, but the user feels tired due to the effort required
Solution Approach 1:
The patent uses the wearable device as a control interface that copies the functionality needed for precise manipulation. Instead of requiring the user to perform complex hand gestures or track virtual objects visually, the wearable device provides familiar input mechanisms (buttons, dials, touchscreens) that the user can operate with minimal physical effort while achieving precise control.
Data Source
AI summary
An augmented reality (AR) device controlled by an external device is provided. The AR device includes a waveguide, an optical engine configured to project a virtual object onto the waveguide, a communication interface configured to establish pairing with a wearable device and transceive data to and from the wearable device, memory storing one or more computer programs, and one or more processors communicatively coupled to the waveguide, the optical engine, the communication interface, and the memory, wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the AR device to recognize the wearable device overlaid on the virtual object, determine to provide the wearable device with control authority for performing or controlling a function related to the virtual object, control the communication interface to transmit, to the wearable device, the control authority and at least one of characteristic information of the virtual object or a data value related to the function, receive, from the wearable device, a changed data value changed by the wearable device based on the transmitted control authority, and update the data value of the function related to the virtual object based on the changed data value.