Smartphone Case IR Tracking for AR/VR Controller Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-worn augmented or virtual reality devices face space constraints for controls, which can interfere with user freedom of movement, and dedicated handheld controls add inconvenience and expense.
Innovation Solution
A smartphone case equipped with LEDs that emit infrared light is used to determine the relative pose between the smartphone and the head-worn device, enabling intuitive user input through visual-inertial odometry and touch input on the smartphone, powered inductively from the device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If controls are integrated into the head-worn device, then user freedom of movement is improved, but device space and control functionality are limited
Solution Approach 1:
The control functionality is extracted from the head-worn device and placed in a separate handheld controller. The controller contains buttons, dials, and other input mechanisms that can be held in the user's hand, while the head-worn device focuses on displaying augmented reality content. This separation allows the head-worn device to remain lightweight and unobtrusive while still providing comprehensive control options through the handheld controller.
Solution Approach 2:
A wireless communication system acts as an intermediary between the handheld controller and the head-worn device. The controller transmits control signals wirelessly to the AR device, enabling communication without physical connections. This intermediary approach allows flexible control while maintaining the portability and freedom of movement associated with head-worn devices.
2Device complexity
If dedicated handheld controls are provided, then control functionality is improved, but portability and convenience deteriorate
Solution Approach 1:
The handheld controller is designed to work with multiple types of head-worn devices, not just a single AR model. The controller can interface with various AR glasses, headsets, or other wearable devices through standardized wireless communication protocols. This multi-functionality increases the controller's versatility and reduces the need for device-specific accessories, improving portability and convenience.
Solution Approach 2:
The controller's operational parameters such as wireless transmission power, data rate, and connection protocols can be dynamically adjusted based on the specific head-worn device being used. This adaptability allows the controller to optimize its performance for different devices while maintaining a single universal design, rather than requiring multiple specialized controllers.
3Device complexity
If dedicated handheld controls are provided, then control functionality is improved, but expense increases
Solution Approach 1:
By designing a universal handheld controller that can work with multiple head-worn devices, the need for separate controllers for different AR devices is eliminated. Users can invest in a single controller that provides comprehensive control functionality across various AR platforms, reducing overall expense while maintaining full control capabilities.
Solution Approach 2:
The controller combines multiple control mechanisms (buttons, dials, touch surfaces, gesture recognition) into a single integrated device. This consolidation provides comprehensive control functionality that would otherwise require multiple separate accessories, reducing the total cost and complexity of the AR system while maintaining versatile control options.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances the efficiency and intuitiveness of interacting with virtual content by using a smartphone case as a controller for head-worn devices, reducing the need for additional hardware and conserving battery life.
Implementation Method 1
A case for a portable device like a smartphone includes light sources such as LEDs, which, when illuminated, can be detected and tracked by a head-worn augmented or virtual reality device
Implementation Method 2
The light sources may be located at the corners of the case, and may emit infrared light. The smartphone and head-worn device are performing visual-inertial odometry (VIO) to track their poses independently
Data Source
AI summary
A case for a portable device like a smartphone includes light sources such as LEDs, which, when illuminated, can be detected and tracked by a head-worn augmented or virtual reality device. The light sources may be located at the corners of the case and may emit infrared light. A relative pose between the smartphone and the head-worn device can be determined based on computer vision techniques performed on images captured by the head-worn device that includes light from the light sources. Relative movement between the smartphone and the head-worn device can be used to provide user input to the head-worn device, as can touch input on the portable device. In some instances, the case is powered inductively from the portable device.