AR Smart Glasses Cursor Control for IoT Screen Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote control devices for IoT-enabled devices, such as smart televisions, require cumbersome navigation through physical buttons, limiting user interaction and causing frustration due to space constraints.
Innovation Solution
AR-enabled wearable electronic devices, like smart glasses, utilize built-in 6DoF tracking and gesture detection to control IoT devices by positioning a cursor on a screen through real-world coordinate tracking and raycasting, allowing users to navigate and select items using hand and head gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical buttons are used on remote control devices, then device structure is simple and manufacturing is easy, but user interaction is limited and navigation is cumbersome
Solution Approach 1:
The patent replaces the mechanical button-pressing system with an optical tracking system. The AR device uses cameras and sensors to detect hand gestures and head movements, translating these physical motions into cursor movements and selections on the television screen. This eliminates the need for physical buttons on the remote control while providing more intuitive and versatile user interaction.
Solution Approach 2:
The patent introduces a cursor as an intermediary between the user and the television interface. Instead of directly pressing buttons to select items, the user controls a virtual cursor through gesture recognition and eye tracking. This intermediary layer enables more precise and flexible interaction with on-screen elements without requiring physical contact with the remote control device.
2Adaptability or versatility
If physical buttons are used on remote control devices, then manufacturing cost is low, but navigation capability is limited
Solution Approach 1:
The AR device serves multiple functions: it acts as both an augmented reality display device and a universal remote control for television navigation. The same gesture recognition system and eye tracking technology enable both AR content consumption and traditional TV control, eliminating the need for separate remote control devices and reducing overall manufacturing costs.
Solution Approach 2:
The patent adds spatial dimensions to remote control interaction by using three-dimensional gesture recognition and eye tracking. Instead of limited two-dimensional button presses, users can navigate through space with hand movements and directional gaze, enabling access to all navigation functions without increasing device complexity.
3Ease of operation
If AR device uses gesture detection and raycasting, then user interaction becomes intuitive, but device complexity increases
Solution Approach 1:
The patent merges the gesture recognition system, eye tracking technology, and raycasting algorithms into a unified control framework. These previously separate complex subsystems are integrated to work together seamlessly, where eye gaze determines cursor position and hand gestures execute commands, creating an intuitive interaction model that feels natural rather than complicated.
Solution Approach 2:
The AR device automatically performs calibration and tracking adjustments without user intervention. The system self-adjusts to different users' eye movements, hand gestures, and viewing positions, eliminating the need for manual configuration and reducing the perceived complexity for end users while maintaining sophisticated underlying functionality.
Data Source
AI summary
AR-enabled wearable electronic devices such as smart glasses are adapted for use as an (Internet of Things) IoT remote control device where the user can control a pointer on a television screen, computer screen, or other IoT enabled device to select items by looking at them and making selections using gestures. Built-in six-degrees-of-freedom (6DoF) tracking capabilities are used to move the pointer on the screen to facilitate navigation. The display screen is tracked in real-world coordinates to determine the point of intersection of the user's view with the screen using raycasting techniques. Hand and head gesture detection are used to allow the user to execute a variety of control actions by performing different gestures. The techniques are particularly useful for smart displays that offer AR-enhanced content that can be viewed in the displays of the AR-enabled wearable electronic devices.