Wearable Display Interface Using Mobile Motion Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current portable electronic devices, such as wearable eyewear, lack effective methods to seamlessly integrate virtual objects into the user's environment using motion data, limiting the immersive and interactive experience in augmented reality applications.
Innovation Solution
A mobile device controller engine is implemented, which includes a face-tracking interface and a rendering engine, allowing the mobile device to communicate with wearable devices and display virtual objects on the eyewear's display by linking the motion data of both the wearable device and the mobile device, enabling a synchronized and interactive experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual objects are displayed on wearable device display, then immersive AR experience is improved, but device complexity increases due to need for motion data integration
Solution Approach 1:
The patent uses the mobile device as an intermediary to collect motion data from sensors (accelerometer, gyroscope, magnetometer) and process it through a rendering engine. This mediator handles the complex motion data integration, allowing the wearable device to display virtual objects without requiring the wearable itself to have complex motion processing capabilities.
Solution Approach 2:
The mobile device serves multiple functions: it acts as the controller engine, collects motion data from various sensors, processes the data through face-tracking and rendering engines, and communicates with the wearable device. This multi-functionality reduces the need for separate specialized components.
2Ease of operation
If virtual objects follow user movements, then interaction intuitiveness is improved, but measurement precision requirements increase
Solution Approach 1:
The system continuously collects motion data from the mobile device's sensors, processes this data through the rendering engine, and updates the virtual object positions in real-time based on the processed motion information. This feedback loop ensures that virtual objects follow user movements intuitively while the system can compensate for minor measurement variations through continuous processing.
3Measurement precision
If face-tracking application is used, then virtual object positioning is improved, but use of energy increases
Solution Approach 1:
The face-tracking application and motion data processing are performed by the mobile device before the wearable device needs to display the virtual objects. By pre-processing the motion data and determining virtual object positions on the mobile device, the system reduces the real-time processing burden and energy consumption on the wearable device during actual AR display.
Data Source
AI summary
Systems, devices, media, and methods are presented for displaying a virtual object on the display of a portable eyewear device using motion data gathered by a face-tracking application on a mobile device. A controller engine leverages the processing power of a mobile device to locate the face supporting the eyewear, locate the hand holding the mobile device, acquire the motion data, and calculate an apparent path of the virtual object. The virtual object is displayed in a series of locations along the apparent path, based on both the course traveled by the mobile device (in the hand) and the track traveled by the eyewear device (on the face), so that the virtual object is persistently viewable to the user.