Context-Aware UI Object Highlighting for Software Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for supporting users during computer program operation are inadequate as they require users to repeatedly request help when context changes, and interactive guidance is not possible, leading to incorrect user interface object selection and operation.
Innovation Solution
A computer-implemented method that uses a navigation file to store process steps with corresponding user interactions, determining the current context and highlighting the correct user interface object based on object properties and match values, ensuring consistent guidance across contexts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If electronic manuals are provided with automatic display based on program context, then help text corresponding to current context is displayed, but user must request help repeatedly when context changes and interactive guidance is not possible
Solution Approach 1:
The system automatically determines the current program context and displays the corresponding help text without requiring user initiation. The context determination unit autonomously monitors program execution state and triggers appropriate help content display, eliminating the need for users to repeatedly request assistance.
Solution Approach 2:
The system continuously monitors program context changes and dynamically adjusts help text display based on current execution state. This feedback mechanism ensures help information remains synchronized with program context, providing accurate guidance throughout the execution process.
2Ease of operation
If user interface objects are highlighted based on predetermined reference features such as position and list order, then user guidance is provided, but incorrect objects are selected when reference features change during program porting or context switching
Solution Approach 1:
The system uses multiple object properties (text content, object type, hierarchical relationship) rather than fixed positional parameters for identification. When programs are ported or contexts change, the system adapts by matching objects based on these flexible properties, ensuring correct identification regardless of position or list order changes.
Solution Approach 2:
The object identification mechanism dynamically adapts to different program contexts and configurations. Rather than relying on static reference features, the system flexibly determines object identity based on current program state and property matching, maintaining reliability across different environments.
3Device complexity
If highlighting is based on fixed reference features, then simple implementation is achieved, but support does not work across different contexts or program states
Solution Approach 1:
The context determination unit and object identification mechanism serve multiple functions: they work across different program contexts, handle various object types, and adapt to different program configurations. This universal approach enables the system to provide consistent guidance functionality throughout the entire program execution lifecycle.
Data Source
Figure 1
Figure 2
Figure 3(a)~3(f)
AI summary
A computer-implemented method is provided to assist a user during the operation of at least one predetermined computer program, wherein during the execution of the computer program at least one user interface object of the computer program is displayed on a display device, wherein the operation of the computer program comprises a number of process steps to be executed, which are stored in a navigation file, wherein each process step is represented by a predetermined user interaction with a predetermined user interface object in a predetermined context of the computer program.The current context of the computer program is determined, the user interface object of the computer program displayed on the display device that corresponds to the user interface object of the process step is identified, and the identified user interface object of the computer program is highlighted on the display device for the user. Furthermore, a system is provided to support a user during the operation of a predetermined computer program, wherein the system is adapted to execute the method according to the invention.