Gaze-Controlled UI Input Method Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Electronic devices that combine gaze information, speech input, and gesture input face inefficiencies due to increased processor computation, leading to suboptimal performance.
Innovation Solution
An electronic device equipped with a first camera for gaze detection, a second camera for gesture input, a microphone for speech recognition, and a processor that determines the appropriate input method based on the type of object selected, allowing for efficient control through a user interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple input methods (gaze, speech, gesture) are used simultaneously, then input versatility is improved, but processor computation load increases
Solution Approach 1:
The system dynamically selects and switches between different input methods (gaze, speech, gesture) based on the current UI context and object type. The processor activates only the necessary input processing pipelines at any given moment, making the system adaptable without permanently maintaining all processing capabilities simultaneously.
Solution Approach 2:
Different input methods are assigned to different UI objects based on their types. For example, text input fields may accept speech input while graphical elements respond to gesture input. This localized assignment of input methods reduces the overall computation load by processing only relevant input types for each specific UI element.
2Ease of operation
If gaze information is continuously processed to activate objects, then user interaction responsiveness is improved, but energy consumption increases
Solution Approach 1:
The gaze processing system operates periodically rather than continuously, checking for gaze activation at specific intervals. This periodic operation maintains user interaction responsiveness while significantly reducing the average energy consumption compared to continuous gaze tracking and processing.
Solution Approach 2:
The system uses the user's natural gaze behavior to trigger processing only when needed. By detecting gaze duration and position, the system automatically determines when object activation is appropriate, eliminating the need for continuous processing and reducing energy consumption while maintaining responsiveness.
Data Source
AI summary
An electronic device is disclosed. The electronic device comprises a first camera and a second camera, a microphone, a display, and a processor electrically connected to the first camera, the second camera, the microphone, and the display, wherein the processor can be set to display, on the display, a user interface (UI) including a plurality of objects, acquire user gaze information from the first camera, activate, among the plurality of objects, a first object corresponding to the gaze information, determine at least one method of input, corresponding to a type of the activated first object, between a gesture input acquired from the second camera and a voice input acquired by the microphone, and execute the function corresponding to the input for the first object While an activated state of the first object is maintained, if the input of the determined method is applicable to the first object. In addition, various embodiments identified through the specification are possible.