Touchscreen Display Segmentation for Speech Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices require multiple steps to activate speech recognition, and using speech input can interfere with ongoing user activities on the screen, making it inconvenient to control devices through speech.
Innovation Solution
An electronic device with a touchscreen display, microphone, speaker, and processor that allows users to input tasks through speech recognition, transmitting data to an external server for processing and displaying relevant interfaces without interrupting current screen activities, using a separate button for easy speech recognition activation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If speech recognition function is activated through multiple processes, then speech recognition capability is enabled, but user operation time and device complexity increase
Solution Approach 1:
The electronic device performs preliminary action by continuously monitoring for wake words or speech inputs even when the speech recognition function is not actively engaged. This allows the device to immediately respond to user commands without requiring separate activation steps, thereby reducing user operation time while maintaining speech recognition capability.
2Ease of operation
If speech input is used to control electronic device, then speech recognition function is utilized, but ongoing user activities on screen are interfered with
Solution Approach 1:
The display interface is segmented into multiple regions, with a first region dedicated to speech recognition interactions and a second region maintaining the ongoing user activity. This spatial segmentation allows speech recognition to proceed without interfering with the user's current task, as both can occur simultaneously in separate areas of the display.
Solution Approach 2:
A notification element acts as an intermediary between the speech recognition function and the ongoing user activity. When speech input is detected, the notification element is displayed in the first region to indicate speech recognition mode activation, while the second region continues to display the user's ongoing activity uninterrupted. This intermediary element mediates the interaction without causing interference.
3Adaptability or versatility
If existing screen is replaced with speech-related screen, then speech operation is enabled, but user's ongoing activity is interrupted
Solution Approach 1:
The display is divided into functional segments where the first region displays speech-related information and the second region maintains the existing application interface. This segmentation enables speech operation capability while preserving the continuity of the user's ongoing activity in the second region, avoiding full screen replacement and its associated interruptions.
Data Source
AI summary
Various embodiments of the present invention relate to an electronic device and a screen control method for processing a user input by using the same, and according to the various embodiments of the present invention, the electronic device comprises: a housing; a touchscreen display located inside the housing and exposed through a first part of the housing; a microphone located inside the housing and exposed through a second part of the housing; at least one speaker located inside the housing and exposed through a third part of the housing; a wireless communication circuit located inside the housing; a processor located inside the housing and electrically connected to the touchscreen display, the microphone, the at least one speaker, and the wireless communication circuit; and a memory located inside the housing and electrically connected to the processor, wherein the memory stores a first application program including a first user interface and a second application program including a second user interface, wherein the memory stores instructions, and when the memory is executed, cause the processor to: display the first user interface on the display, while displaying the first user interface, receive a user input through at least one of the display or the microphone, wherein the user input includes a request for performing a task using the second application program, transmit data associated with the user input to an external server via the communication circuit, receive a response from the external server via the communication circuit, wherein the response includes information on a sequence of states of the electronic device to perform the task, and after receiving the response, display the second user interface on a first region of the display, based on the sequence of the states, while displaying a portion of the first user interface on a second region of the display. Other various embodiments, in addition to the various embodiments disclosed in the present invention, are possible.