Multitasking Window State Control via Multimodal Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In a multitasking environment, multimodal interface-based inputs often unintentionally change the state of windows, leading to user inputs being misapplied, as intended inputs may not reach the correct application due to unintended changes in foreground or background states of application windows.
Innovation Solution
A method for controlling the state of windows in a multitasking environment, where user inputs are processed based on multimodal interfaces, ensuring that inputs are correctly applied by determining specific conditions to maintain or change the state of windows according to user intent, using a processor to manage the execution of applications and their respective windows.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multimodal interface-based inputs are processed in a multitasking environment, then multiple simultaneous controls are possible, but the state of windows may be unintentionally changed causing inputs to be applied to wrong applications
Solution Approach 1:
The system determines whether to change the window state before processing the input, by checking if the input type corresponds to a background application. This preliminary check prevents unintended window state changes that would cause inputs to be applied to wrong applications.
Solution Approach 2:
The system provides feedback by determining the current window state and comparing it with the intended target application state. Based on this feedback, the system adjusts the window state management to ensure inputs are applied to the correct application, resolving the reliability issue.
2Ease of operation
If a window is changed to foreground state upon receiving input, then the input can be processed by the intended application, but other windows are changed to background state which may cause re-changing of states
Solution Approach 1:
The system applies preliminary anti-action by preventing window state changes when the input is intended for a background application. By checking the correspondence between input type and application state beforehand, the system avoids unnecessary window state transitions that would cause instability and re-changing.
3Device complexity
If keyboard input is always applied to foreground window, then simple input handling is achieved, but user intent may be ignored when input should go to background application
Solution Approach 1:
The system implements dynamic input routing by making the input handling behavior adaptable based on the current window state and input type. When the current window is in background state and corresponds to the input type, the system dynamically routes the input to the appropriate application, maintaining both simplicity and user intent recognition.
Data Source
Figure 1a
Figure 1b
Figure 1c
AI summary
An electronic device is configured to support a multitasking environment, the electronic device comprises a communication circuit configured to communicate with at least one external device; a microphone configured to receive voice input; a memory storing a plurality of application programs; a display configured to output a plurality of virtual windows as the plurality of application programs are executed and at least one processor electrically connected with the communication circuit, the microphone, the memory, and the display, wherein the processor is configured to execute the plurality of application programs.