Voice Command Execution Across Heterogeneous IoT Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing voice command systems face difficulties in executing user commands when the device receiving the command and the target device are different or physically far apart, leading to processing challenges and reduced efficiency due to incomplete parameter information and lack of feedback.
Innovation Solution
An integrated intelligence system that includes a user terminal, intelligence server, personal information server, suggestion server, and cloud server, which processes voice commands by generating path rules, managing user information, and identifying external devices to provide necessary parameters and feedback, ensuring seamless execution of commands across connected devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the electronic device receives all parameters necessary for the voice command before processing, then the voice command can be processed completely, but the processing speed is reduced and feedback is delayed
Solution Approach 1:
The system performs preliminary actions by notifying the user of missing parameters before full processing completes. The electronic device identifies which parameters are missing and notifies the user in advance, allowing the user to prepare or provide the missing information while other processing continues, thus reducing overall processing time without sacrificing completeness
Solution Approach 2:
The system implements feedback by actively notifying the user about missing parameters during the voice command processing. The electronic device provides real-time feedback about what information is needed, enabling the user to respond appropriately and allowing the system to continue processing other aspects of the command in parallel
2Adaptability or versatility
If the electronic device that receives the voice command and the target device are different, then remote control is enabled, but execution difficulty increases due to parameter information gaps
Solution Approach 1:
The system uses the user terminal as an intermediary between the voice command receiving device and the target device. When a voice command is given to control a different device, the user terminal receives the command, identifies missing parameters, notifies the user, and coordinates with the target device to obtain necessary information, thereby facilitating remote control while managing parameter gaps
Solution Approach 2:
The system implements feedback mechanisms to inform the user about missing parameters when controlling remote devices. The electronic device notifies the user of what additional information is needed to execute the voice command on the target device, enabling the user to provide the necessary parameters and making remote control more manageable
3Adaptability or versatility
If the electronic device and target device are physically far apart, then IoT network connectivity is required, but execution difficulty increases due to communication delays and parameter losses
Solution Approach 1:
The system performs preliminary identification of missing parameters through the user terminal before attempting full command execution. By notifying the user of what information is missing in advance, the system allows time for parameter collection over the network without delaying the overall process, compensating for communication delays inherent in IoT connectivity
Solution Approach 2:
The user terminal acts as an intermediary that manages communication between the voice command device and the remotely located target device. It coordinates parameter collection, notifies users of missing information, and manages the data exchange over the network, thereby reducing information loss despite physical distance and communication delays
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Disclosed are an electronic device and a method of controlling an operation of the electronic device. A method comprises receiving first data related to an input comprising a request for performing a task using a second external device and obtained through a microphone and comprising information on a user interface of a first external device from the first external device, identifying a sequence of states of the second external device for executing the task based on at least some of the first data, transmitting first information on the sequence of states of the second external device to the second external device through the network interface, receiving second data indicative of a need for an additional input for completing the task from the second external device through the network interface, and transmitting second information to the first external device based on at least some of the second data.