AR Glasses Cursor Control for IoT Screens Using 6DoF Gestures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote control devices for IoT-enabled devices, such as smart televisions, require cumbersome navigation through physical buttons, limiting user interaction and causing frustration due to space constraints.
Innovation Solution
AR-enabled wearable electronic devices, like smart glasses, utilize built-in 6DoF tracking and gesture detection to control IoT devices by positioning a cursor on a screen through real-world coordinate tracking and raycasting, allowing users to navigate and select items using hand and head gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical buttons are used on remote control devices, then device structure is simple and manufacturing is easy, but user interaction is limited and navigation is cumbersome
Solution Approach 1:
The patent replaces mechanical button presses with optical and motion-based interactions. The AR wearable device uses camera-based gesture recognition and head tracking to control the television, eliminating the need for physical buttons on the remote control device itself.
Solution Approach 2:
The patent introduces an intermediary system consisting of the AR wearable device, which acts as a mediator between the user and the television. This intermediary captures gestures and head movements, processes them, and translates them into television control commands.
2Adaptability or versatility
If more buttons are added to remote control devices to expand functionality, then user interaction capability improves, but physical space requirements increase and device becomes more complex
Solution Approach 1:
The patent transitions from two-dimensional button layouts on a remote control to three-dimensional gesture space. Users can perform gestures in multiple directions and planes, and the system tracks head movement in three-dimensional space, effectively adding spatial dimensions to the control interface.
Solution Approach 2:
The patent replaces static buttons with dynamic gestures. The control interface adapts to user movements in real-time, capturing gestures such as hand waves, circular motions, and directional movements, providing unlimited functionality without requiring additional physical space.
3Productivity
If physical remote control devices are used, then device structure is straightforward, but navigation through menus is time-consuming and frustrating
Solution Approach 1:
The patent implements preliminary action by allowing users to point at items on the screen using head movements before selecting them. The system anticipates user intent by tracking gaze direction and positioning the cursor accordingly, enabling faster navigation compared to sequential button pressing.
Solution Approach 2:
The patent uses the television screen itself as a reference for control actions. The AR wearable device captures images of the screen, identifies UI elements, and maps gestures to corresponding screen positions, creating a direct visual-copy relationship between the display and control interface.
Data Source
AI summary
AR-enabled wearable electronic devices such as smart glasses are adapted for use as an (Internet of Things) IoT remote control device where the user can control a pointer on a television screen, computer screen, or other IoT enabled device to select items by looking at them and making selections using gestures. Built-in six-degrees-of-freedom (6DoF) tracking capabilities are used to move the pointer on the screen to facilitate navigation. The display screen is tracked in real-world coordinates to determine the point of intersection of the user's view with the screen using raycasting techniques. Hand and head gesture detection are used to allow the user to execute a variety of control actions by performing different gestures. The techniques are particularly useful for smart displays that offer AR-enhanced content that can be viewed in the displays of the AR-enabled wearable electronic devices.