Touchless UX Initiation via Confidence-Based Proximity and Gesture Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current electronic devices, such as smart home devices, rely on voice or touch inputs which can be disruptive and do not consider their physical context, leading to a suboptimal user experience.
Innovation Solution
An electronic device configured to provide touchless user experience operations based on proximity and gesture detection, using sensors like IR, ultrasound, and cameras to initiate actions with a confidence level, adapting sensor usage for accurate and contextual interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If voice or touch inputs are used to initiate functions, then the electronic device can respond to user commands, but the user experience becomes disruptive and lacks contextual awareness
Solution Approach 1:
The system performs preliminary actions by detecting user presence and predicting needs before the user actually interacts with the device. Sensors continuously monitor the environment to identify when a user is approaching or present, allowing the device to proactively prepare and present relevant information or controls before being explicitly commanded, thus eliminating the need for disruptive voice or touch inputs.
Solution Approach 2:
The electronic device serves itself by automatically detecting presence, determining proximity, and initiating appropriate user experience operations without requiring external voice or touch commands. The system uses sensor data to autonomously decide when to display information, adjust settings, or present controls, making the interaction seamless and non-disruptive.
2Adaptability or versatility
If the electronic device provides comprehensive information and controls, then user needs are met, but the interface becomes complex and overwhelming
Solution Approach 1:
The system applies local quality by tailoring the information and controls presented to the specific local context of each user situation. Based on detected presence and proximity, the device selectively displays only the most relevant information and controls for that particular moment and user, rather than presenting all possible functions simultaneously. This creates a simplified, context-appropriate interface that adapts to user needs.
Solution Approach 2:
The interface dynamically adjusts its complexity and content based on real-time sensor data about user presence and proximity. As users move closer or farther from the device, the system dynamically modifies what information is displayed and what controls are available, transitioning smoothly between different levels of interaction complexity to match the user's physical context.
3Measurement precision
If multiple sensors are used for accurate presence and gesture detection, then detection precision improves, but device complexity and energy consumption increase
Solution Approach 1:
The system merges multiple sensor types (cameras, microphones, IR sensors, ultrasound sensors) into a unified presence and gesture detection system. By combining the capabilities of these different sensors, the device achieves high measurement precision for detecting user presence, distance, and gestures while managing the complexity through integrated processing that coordinates all sensor inputs into a cohesive understanding of the user context.
Solution Approach 2:
The sensor system is designed with multi-functionality, where the same set of sensors serves multiple purposes: detecting presence, determining proximity distance, recognizing gestures, and even monitoring environmental conditions. This universal approach allows accurate measurement across different parameters using a single integrated sensor suite, reducing overall system complexity compared to having separate dedicated sensors for each function.
4Adaptability or versatility
If the electronic device proactively predicts user needs, then user experience becomes delightful and contextual, but the system requires sophisticated processing and decision-making
Solution Approach 1:
The system uses feedback loops where sensor data about user presence and behavior is continuously monitored, processed to predict user needs, and then used to adjust the displayed information and controls. This feedback mechanism enables contextual awareness by constantly adapting the interface based on real-time observations of user actions and environmental conditions, creating a proactive and delightful experience without requiring overly complex centralized decision-making.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables a smart, contextual, and delightful user experience by providing relevant information and controls automatically, enhancing user interaction without disrupting regular activities.
Implementation Method 1
The sensor module may include one or more infrared (IR) sensors, one or more ultrasound sensors, one or more cameras
Implementation Method 2
The sensor module may include one or more infrared (IR) sensors, one or more ultrasound sensors, one or more cameras
Data Source
AI summary
This application is directed to a method for controlling user experience (UX) operations on an electronic device that executes an application. A touchless UX operation associated with the application has an initiation condition including at least detection of a presence and a gesture in a required proximity range with a required confidence level. The electronic device then determines from a first sensor signal the proximity of the presence with respect to the electronic device. In accordance with a determination that the determined proximity is in the required proximity range, the electronic device determines from a second sensor signal a gesture associated with the proximity of the presence and an associated confidence level of the determination of the gesture. In accordance with a determination that the determined gesture and associated confidence level satisfy the initiation condition, the electronic device initializes the touchless UX operation associated with the application.