Context-Aware Operation Assistance for Terminal Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing information processing apparatuses for assisting terminal operations always display a guideline screen, regardless of the current screen state, leading to unnecessary repeated queries and assistance, as users cannot perform operations without the guidance screen being displayed.
Innovation Solution
An information processing apparatus that determines the required operation procedure based on sound data and current screen information, then controls the display to provide assistive guidance, allowing users to perform operations directly from their current screen.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the information processing apparatus always displays the guideline screen in response to user questions, then the user can understand the operation procedure from the guidance screen, but the user cannot perform operations from their current screen and must repeatedly ask the same question
Solution Approach 1:
The system performs preliminary analysis of the current screen state before providing operation guidance. By capturing and analyzing the current screen information in advance, the system can provide context-aware guidance that is relevant to the user's actual screen state, eliminating the need for users to repeatedly describe their situation
Solution Approach 2:
The system implements feedback by analyzing the current screen state and using this information to adapt the guidance provided. The screen information analysis unit continuously monitors the current display state and feeds this information back to the operation procedure determination unit, which adjusts the guidance based on the actual screen context, creating a closed-loop assistance system
2Reliability
If the guideline screen is always displayed when the user asks a question, then the user can understand the operation procedure, but the assistance frequency does not decrease and redundant queries occur
Solution Approach 1:
The system changes the parameter of guidance delivery by transitioning from a static, always-same guideline screen to a dynamic, context-adapted guidance display. By varying the guidance content based on screen state analysis, the system maintains high reliability while improving assistance efficiency and reducing redundant queries
3Ease of operation
If the system provides operation guidance without considering the current screen state, then the guidance can be simplified, but the guidance becomes irrelevant to the user's actual screen and requires repeated assistance
Solution Approach 1:
The system extracts relevant information from the current screen state through the screen information analysis unit. By selectively extracting and utilizing key screen context information, the system maintains guidance simplicity while ensuring the guidance is relevant to the user's actual screen situation, preventing loss of critical context
Data Source
AI summary
An information processing apparatus (2) is an information processing apparatus for assisting an operation by an user of a terminal apparatus (1) that is operable by the user, and includes: a determination unit (211) for determining a procedure of an operation that should be performed by the user based on sound data that indicates, as a sound, a question from the user about the operation of the terminal apparatus and an information related to a present screen displayed on a display unit (14) of the terminal apparatus when the user asks the question about the operation of the terminal apparatus; and a control unit (212) for controlling the display unit to perform an assist display processing for encouraging the user to operate the terminal apparatus with the procedure determined by the determination unit.