Multi-Mode Interaction Interface for Efficient Function Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current human-machine interaction methods, such as voice, gesture, and touch interactions, are inefficient and difficult for users to control, requiring multiple commands or gestures to adjust functions like volume, brightness, and temperature, leading to operational complexity.
Innovation Solution
A system that combines multiple interaction modes (voice, gesture, and touch) to simplify function control by providing an interface based on initial input, allowing users to perform functions with fewer interactions and reducing the need to navigate through multiple interfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If voice interaction mode is used to control functions, then the user can input commands naturally, but the user requires multiple commands and accurate determination of adjustment information, leading to operational inefficiency
Solution Approach 1:
The patent combines voice interaction mode with gesture interaction mode into an integrated system. The voice command triggers the function interface, and the gesture input completes the adjustment, merging the natural language understanding capability with the precise control capability to achieve both ease of operation and operational efficiency
Solution Approach 2:
The voice command performs preliminary action by pre-selecting the target function and displaying the corresponding interface. This preliminary action prepares the system state so that the subsequent gesture input can directly adjust the parameter without requiring the user to navigate through multiple interfaces or determine adjustment increments
2Productivity
If gesture interaction mode is used to control functions, then the user can perform adjustments with gestures, but the number of gestures exceeds 6, increasing the difficulty of remembering gestures
Solution Approach 1:
The patent segments the interaction process into two distinct phases: function selection (via voice) and parameter adjustment (via gesture). This segmentation allows each interaction mode to be optimized for its specific purpose, reducing the overall cognitive load and gesture memory requirements while maintaining operational efficiency
Solution Approach 2:
The patent implements a unified gesture set that can be used across different function interfaces. The same gesture patterns (e.g., swipe up/down, left/right) work for adjusting parameters in different functions, providing universality that reduces the number of gestures the user needs to remember while maintaining operational efficiency
3Ease of operation
If touch interaction mode is used to control functions, then the user can navigate interfaces with touch inputs, but the user requires switching between desktop and multiple settings interfaces, leading to operational inefficiency
Solution Approach 1:
The voice command acts as an intermediary that directly opens the target function interface from the desktop, bypassing the need to navigate through multiple settings interfaces. This intermediary action bridges the gap between the user's intent and the function execution, improving operational efficiency while maintaining ease of operation through natural voice input
4Productivity
If multiple interaction modes are combined, then the user can access functions with fewer interactions, but the system complexity increases
Solution Approach 1:
The patent implements a dynamic interaction system that automatically adapts the interaction flow based on the user's input. The system dynamically switches between voice-only mode, gesture-only mode, and combined voice-gesture mode depending on the context, allowing the system to remain efficient without requiring complex manual configuration or increasing perceived user complexity
Data Source
AI summary
The present application discloses methods, devices, and a system for an interaction between a terminal and a user. A method includes obtaining, by one or more processors, a first input, the first input being input via a first interaction mode, providing, by the one or more processors, an interface, the interface being displayed based at least in part on the first input, obtaining, by the one or more processors, a second input, the second input being input via a second interaction mode, the second interaction mode being different from the first interaction mode, and performing, by the one or more processors, a function corresponding to the interface, the function being based at least in part on one or more of the first input, the first interaction mode, the second input, and the second interaction mode.