Information Processing Device Multimodal Command Candidate Presentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face challenges in accurately and efficiently operating multiple connected devices using voice agents due to the complexity of remembering and executing various voice and gesture commands, leading to potential errors and malfunctions.
Innovation Solution
An information processing device and method that utilizes partial match search and multimodal interaction to assist users in issuing commands by presenting candidates for imperfect inputs, allowing users to select from voice or gesture options, and automatically registering frequently performed operations as shortcuts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If users issue voice or gesture commands to operate multiple connected devices, then device operation capability is enhanced, but command accuracy and reliability deteriorate due to the complexity of remembering and executing various commands
Solution Approach 1:
The system provides feedback by presenting candidate commands that match the user's input, allowing users to select from suggested options. This feedback mechanism helps users correct imperfect inputs and ensures accurate command execution, thereby improving reliability while maintaining versatility in device operation.
Solution Approach 2:
The system introduces an intermediary processing layer that translates imperfect user inputs into candidate commands. This intermediary layer acts as a mediator between the user's intent and the actual command execution, resolving ambiguities and improving command accuracy without limiting the range of operable devices.
2Measurement precision
If the system presents candidate commands for imperfect inputs, then command accuracy improves, but interaction time increases due to the need for user selection
Solution Approach 1:
The system performs partial matching of user inputs to generate candidate commands, presenting only the most relevant options rather than requiring complete precision. This approach achieves sufficient command accuracy while minimizing the number of candidates users need to review, thereby reducing interaction time.
Solution Approach 2:
The system performs preliminary processing of user inputs to generate and present candidate commands before final execution. By preparing candidate options in advance based on the user's input, the system reduces the time required for command selection while maintaining high accuracy through pre-computed matching results.
3Ease of operation
If the system automatically registers frequent operations as shortcuts, then ease of operation improves, but device complexity increases due to additional processing requirements
Solution Approach 1:
The system provides self-service by automatically monitoring and analyzing user operations to identify frequent patterns. It then autonomously creates shortcut commands for these frequent operations without requiring manual user configuration, thereby improving ease of operation while adding minimal complexity through automated learning algorithms.
Solution Approach 2:
The system creates simplified copies or shortcuts of frequent complex operations. By generating abbreviated command versions of commonly performed sequences, the system reduces the operational steps users must execute while maintaining the full functionality of the original operations, balancing simplicity with manageable system complexity.
Data Source
AI summary
To provide an information processing device, an information processing method, and a computer program that assist a device operation of a user.An information processing device includes an input unit that receives input from a user, and a presentation unit that presents information regarding a command for operating a predetermined device on the basis of the input. The input unit receives input by at least one of voice or gesture from a user. The presentation unit presents a candidate of a command including at least one of voice or gesture and partially matching the input.