AR Smart Glasses Gesture Control for IoT Screen Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Smart televisions with IoT features face cumbersome navigation and limited user interactions due to physical remote controls, leading to customer frustration.
Innovation Solution
AR-enabled wearable devices, such as smart glasses, provide six degrees of freedom tracking and hand/head gesture detection to control IoT devices like smart televisions, allowing users to navigate and interact through augmented reality content using gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical remote control devices with buttons are used, then users can control IoT devices, but navigation becomes cumbersome and user interactions are limited
Solution Approach 1:
The patent replaces the mechanical button-based remote control system with an optical/gesture-based AR interface. Users wear AR smart glasses that detect hand gestures and translate them into navigation commands, eliminating the need for physical buttons and directional keys. This substitution dramatically simplifies the user interaction model while removing the complexity of physical remote control design.
Solution Approach 2:
The AR smart glasses act as an intermediary device between the user and the IoT system. Instead of directly manipulating physical remote controls or touching screens, users perform natural gestures that the AR glasses capture and convert into system commands. This intermediary layer enables intuitive gesture-based navigation and control, resolving the contradiction between ease of operation and device complexity.
2Adaptability or versatility
If physical remote controls with limited buttons are used, then device structure is simple, but the number of actions users can perform is limited
Solution Approach 1:
The patent implements a dynamic control interface where the AR smart glasses adapt to user needs in real-time. The system detects various hand gestures and dynamically maps them to different control functions, allowing users to perform multiple actions without additional physical buttons. The interface evolves based on context, providing versatile interaction capabilities while maintaining a simple wearable form factor.
Solution Approach 2:
The patent adds a temporal and spatial dimension to control by using gesture recognition over time and space. Instead of static buttons, the system captures three-dimensional hand movements across multiple frames, extracting meaningful gestures from spatial-temporal data. This dimensional expansion enables numerous control actions to be performed with simple hand motions, greatly increasing adaptability without adding physical complexity.
3Ease of operation
If traditional remote control navigation is used, then device implementation is straightforward, but user experience becomes frustrating
Solution Approach 1:
The patent replaces sequential button-press navigation with parallel gesture-based navigation. Multiple navigation options are presented simultaneously through the AR interface, and users can directly select targets using hand gestures rather than navigating through hierarchical menus step-by-step. This substitution dramatically reduces navigation time and eliminates the frustration of cumbersome traditional remote control operation.
Data Source
AI summary
AR-enabled wearable electronic devices such as smart glasses are adapted for use as an (Internet of Things) IoT device where the user can control a pointer and present augmented reality content with respect to a television screen, computer screen, or other IoT enabled device by selecting items by looking at them and making selections using gestures. Built-in six-degrees-of-freedom (6DoF) tracking capabilities are used to track the television display screen to facilitate cursor navigation and display of AR content. The tracking information is used to trigger an AR effect for display of augmented reality content relative to the physical television display screen (e.g., on or in the environment around the television display screen) on demand in response to gestures. The techniques are particularly useful for smart displays that offer AR-enhanced content that can be viewed in the displays of the AR-enabled wearable electronic devices.