Multimodal IoT Action Setup Using Voice and Gesture Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing IOT devices require users to manually set detailed conditions and functions, which is cumbersome and inefficient, especially with the rise of artificial intelligence systems that can learn and adapt.
Innovation Solution
An electronic device that acquires voice and image information from user interactions to automatically determine events and functions to be executed based on conditions, using machine learning algorithms to identify detection and execution resources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users manually set detailed conditions and functions for IOT devices, then the device can execute specific functions according to conditions, but the setup process becomes cumbersome and time-consuming
Solution Approach 1:
The system enables automatic condition setting by analyzing user behavior patterns and environmental data through machine learning algorithms. The IOT device autonomously identifies conditions and corresponding functions without requiring manual configuration, allowing the system to serve itself in the setup process.
Solution Approach 2:
The patent replaces the mechanical manual configuration process with an automated intelligent system that uses machine learning and data analysis. Instead of users manually setting conditions through interfaces, the system automatically processes user interactions and environmental data to generate condition-function mappings.
2Adaptability or versatility
If traditional rule-based smart systems are used, then conditions can be explicitly defined, but the system lacks adaptability to user preferences and contextual variations
Solution Approach 1:
The system dynamically adjusts detection parameters and analysis methods based on the specific context and user behavior patterns. Machine learning models modify their detection thresholds, feature weights, and processing strategies according to learned user preferences and environmental conditions, enabling adaptive recognition without rigid rule configurations.
Solution Approach 2:
The patent implements a unified machine learning-based framework that handles multiple types of conditions and functions through a single adaptable system. Instead of separate rule-based modules for different scenarios, one intelligent system processes diverse user interactions, environmental data, and contextual variations using learned patterns, providing universal adaptability across different IOT applications.
Data Source
AI summary
An approach for controlling method of an electronic device is provided. The approach acquires voice information and image information for setting an action to be executed according to a condition, the voice information and the image information being respectively generated from a voice and a behavior associated with the voice of a user. The approach determines an event to be detected according to the condition and a function to be executed according to the action when the event is detected, based on the acquired voice information and the acquired image information. The approach determines at least one detection resource to detect the determined event. In response to the at least one determined detection resource detecting at least one event satisfying the condition, the approach executes the function according to the action.