Terminal Voice Gesture Control via Adaptive Management Layer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for controlling applications on terminals, such as mobile phones, rely heavily on touch operations, which are limited and require re-development of applications to accommodate voice or gesture instructions, leading to increased costs and time.
Innovation Solution
A method that allows controlling applications using voice or gesture instructions by determining the corresponding control from a database-based configuration file, eliminating the need to re-develop existing applications, and utilizing an adaptive management application to manage identification information and interactive events within the terminal's framework layer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If applications are re-developed to accommodate voice or gesture instructions, then control functionality is improved, but development cost and time increase
Solution Approach 1:
An adaptive management application is introduced as an intermediary layer between the user's voice/gesture instructions and the original applications. This mediator translates non-contact instructions into standard control commands that existing applications can execute, enabling new control methods without modifying the original application code.
Solution Approach 2:
The adaptive management application provides universal control capabilities across multiple applications through a single unified system. It manages identification information and interactive events that can be applied to any application, allowing one solution to serve multiple functions and applications simultaneously.
2Adaptability or versatility
If applications are re-developed to accommodate voice or gesture instructions, then control functionality is improved, but development cost increases
Solution Approach 1:
The adaptive management application serves as a cost-effective intermediary that adds voice and gesture control capabilities without requiring expensive re-development of each individual application. By centralizing the translation and control logic in a single management layer, development resources are optimized.
Solution Approach 2:
Instead of modifying original applications, the system creates a virtual layer that copies and translates control instructions into formats the original applications can understand. This approach preserves the integrity of existing applications while adding new functionality through a separate management system.
3Ease of operation
If touch operations are used for application control, then operation method is simple, but operation flexibility is limited
Solution Approach 1:
The system dynamically adapts between different operation modes, allowing users to switch between traditional touch operations and non-contact voice/gesture instructions. The adaptive management application processes various input types and translates them into appropriate control actions, providing operational flexibility while maintaining simplicity.
Solution Approach 2:
The system changes the parameters of interaction by accepting different types of input (touch, voice, gesture) and translating them into standardized control commands. This parameter transformation enables diverse operation methods while maintaining compatibility with existing application interfaces.
Data Source
AI summary
Disclosed are a method of controlling applications in a terminal and a terminal, which may extend the control methods of the applications installed in the terminal. The method includes: receiving a user operation instruction including a voice instruction or a gesture instruction that is not in contact with the terminal, during a display of a first operation interface of a first application by the terminal; determining a first control corresponding to the user operation instruction from at least one control on the first operation interface; and executing a response program of the first control.