Voice Input Apparatus for Natural User Interface Targeting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users find it difficult to understand which symbol to manipulate on natural user interfaces (NUIs) when multiple UI components are involved, as existing technologies do not adequately address the challenge of specifying a manipulation target.
Innovation Solution
An information processing device and method that defines an address term for a partial region of an image displayed on a screen, temporarily displays this term alongside the image, and issues commands based on voice inputs that include the address term, allowing users to easily identify and interact with specific UI components.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple UI components are selectively manipulated by NUI, then the functionality and versatility of the interface is improved, but the user's ability to understand which symbol specifies the manipulation target deteriorates
Solution Approach 1:
The system performs preliminary action by temporarily displaying address terms (symbols) on the display device before the user issues a voice command. This allows users to see and understand which UI component will be manipulated before the actual operation occurs, resolving the contradiction between versatile NUI functionality and user comprehension of manipulation targets
Solution Approach 2:
The system implements feedback by displaying address terms in response to user requests (such as when a predetermined button is pressed). This feedback mechanism shows users which symbols correspond to which UI components, enabling them to understand the manipulation targets while maintaining the ability to selectively manipulate multiple UI components through voice commands
Data Source
AI summary
There is provided a voice input device including a processor configured to realize an address term definition function of defining an address term for at least a partial region of an image to be displayed on a display, a display control function of displaying the image on the display and temporarily displaying the address term on the display in association with the region, a voice input acquisition function of acquiring a voice input for the image, and a command issuing function of issuing a command relevant to the region when the address term is included in the voice input.