Multimodal Terminal Control for Conflicting Voice and Gesture Inputs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In smart home systems, multiple voice or gesture instructions received within a short time period often result in conflicting settings due to instruction conflicts, leading to incorrect settings.
Innovation Solution
A method and device that determine the credibility of each control instruction by comparing it with pre-stored instructions, calculating a matching degree, and sending the control instruction with the highest credibility to the terminal, thereby avoiding conflicts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If multiple voice or gesture instructions are received within a short time period, then the system can respond to user operations quickly, but instruction conflicts occur leading to incorrect settings
Solution Approach 1:
The system performs preliminary actions by pre-storing control instructions and their associated keywords before receiving user inputs. When multiple instructions are received within a short time period, the system compares the received instructions against the pre-stored instructions to determine credibility, allowing quick response while maintaining setting accuracy through pre-established reference data
Solution Approach 2:
The system implements feedback by calculating a matching degree between received control instructions and pre-stored instructions, then using this matching degree to determine credibility. This feedback mechanism allows the system to identify and prioritize reliable instructions among conflicting inputs, ensuring accurate settings even when multiple instructions are received rapidly
2Ease of operation
If all control instructions are processed equally, then the system is simple to operate, but conflicting instructions lead to incorrect settings
Solution Approach 1:
The system changes the parameter of instruction processing by introducing a credibility parameter based on matching degree. Instead of processing all instructions equally, the system calculates how well each received instruction matches pre-stored instructions, assigns credibility scores, and processes instructions in order of credibility. This maintains operational simplicity while ensuring accurate settings by automatically prioritizing reliable instructions
Data Source
AI summary
The present disclosure provides a method for controlling a terminal, including the following operations: obtaining recognition results corresponding to control signals after receiving the control signals, and determining whether control instructions corresponding to the recognition results conflict, each control signal comprising at least one of a voice signal or a gesture signal; determining a credibility of each control instruction in response to a determination that there exists conflict among control instructions; and sending the control instruction with highest credibility to a control terminal. The present disclosure further provides a device for controlling a terminal and a computer readable storage medium. When control instructions are received and there exists conflict among control instructions, the control instruction with the highest credibility is sent to the control terminal after the credibility of each control instructions is determined, thereby avoiding settings from conflict.