Floating Window Voice Control for Mobile Terminals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mobile terminals lack an efficient method to seamlessly integrate voice recognition with content selection and application execution, limiting user interaction and functionality, especially in multitasking environments.
Innovation Solution
A mobile terminal with a controller that converts a control window into a movable floating window, allowing users to select content by overlapping it with items on the screen, and execute applications based on voice commands, enabling direct use of displayed content without limiting the execution screen.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a control window is displayed to control voice recognition mode, then voice recognition functionality is enabled, but the display area for content is reduced and user interaction becomes cumbersome
Solution Approach 1:
The control window is transformed from a static full-screen interface to a dynamic floating window that can be freely positioned and resized on the display. This allows the window to adapt to different content areas and user preferences, maintaining voice recognition functionality while preserving maximum display area for content.
Solution Approach 2:
The control window is elevated to a separate visual layer (floating above content), allowing it to coexist with content display without completely blocking the view. This dimensional separation enables simultaneous access to both voice recognition controls and underlying content.
2Ease of operation
If users switch screens to select content for voice commands, then content selection is possible, but interaction efficiency decreases and multitasking is hindered
Solution Approach 1:
The content selection functionality is merged directly into the floating control window by enabling users to drag the window over target content areas. This integration eliminates the need to switch between separate content viewing screens and voice command screens, allowing both functions to occur simultaneously on the same display.
Solution Approach 2:
The floating control window acts as an intermediary element that bridges voice command input and content selection. By dragging this intermediate window over desired content, users can select content for voice commands without leaving the current screen context.
3Device complexity
If a fixed control window is used for voice recognition, then the interface is simple, but flexibility in content selection and positioning is limited
Solution Approach 1:
The control window transitions from a fixed, static position to a dynamic, movable floating window that users can reposition anywhere on the display. This dynamic behavior maintains interface simplicity while dramatically increasing flexibility in content selection and positioning.
Solution Approach 2:
By elevating the control window to a floating layer above content, the interface gains dimensional flexibility. The window can now be positioned independently of content boundaries, allowing users to access any content area while maintaining a simple drag-and-drop interaction model.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
There is provided a mobile terminal and a method of controlling a mobile terminal. The mobile terminal according to the one embodiment analyzes a voice signal received through the audio input unit, when going to a voice recognition mode, selects at least one application to be executed, and at least one item of content to be used in the application, according to the analyzed voice signal, wherein the at least one item of content is selected from items of content displayed on the touch screen, and executes the selected at least one application by using the selected at least one item of content according to the analyzed voice signal.