Annotation Display on Terminal Devices via Active Window Monitoring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current business systems lack the ability for users to directly describe and share business knowledge linked to user interfaces on terminal devices without modifying the existing system, leading to inefficient knowledge sharing and documentation, especially when dealing with dynamic screen changes and widgets.
Innovation Solution
A terminal device with an annotation database that monitors active windows and displays annotation texts and icons based on user operations, allowing for easy addition and editing of annotations, with a system that synchronizes annotation rules between client and server databases to improve efficiency and reduce calculation overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If template matching of an image is applied to the entire screen by default, then text can be displayed on the screen, but the calculation amount increases
Solution Approach 1:
The patent divides the screen into multiple window regions and applies template matching only within the active window region rather than the entire screen. This segmentation reduces the search space for template matching, thereby decreasing the calculation amount while maintaining the ability to display annotations at appropriate locations.
Solution Approach 2:
The patent applies different processing strategies to different regions of the screen based on their characteristics. The active window region receives template matching processing for annotation display, while other regions are excluded from this processing. This local quality approach optimizes resource allocation by applying computational processing only where necessary.
2Ease of operation
If image matching is performed regardless of window active or inactive state, then annotations can be displayed, but the calculation amount increases due to constant monitoring
Solution Approach 1:
The patent dynamically adjusts the template matching process based on the active state of windows. Template matching is performed only when a window is in the active state, and the system dynamically updates the matching process when window states change. This dynamic approach reduces unnecessary calculations while maintaining responsive annotation display.
Solution Approach 2:
Instead of continuous monitoring of all windows, the patent implements periodic action by triggering template matching only at specific events such as window activation or state changes. This event-driven approach reduces the frequency of calculations while ensuring annotations are displayed timely when needed.
3Device complexity
If users cannot select text they want to see from candidates, then the system is simpler, but the user interface is less effective
Solution Approach 1:
The patent generates multiple candidate annotations through template matching but displays only the most relevant ones to the user's current context. This partial action approach provides users with selective information without overwhelming them with all possible annotations, balancing system complexity with user interface effectiveness.
4Device complexity
If a DB for editing is not provided, then the system is simpler, but users cannot collectively edit and share text display portions
Solution Approach 1:
The patent implements a database that serves multiple functions: storing template images, managing annotation texts, enabling user editing, and facilitating knowledge sharing across users. This universal database structure supports both the technical requirements of template matching and the collaborative requirements of knowledge sharing, reducing the need for separate systems.
Solution Approach 2:
The patent introduces a database as an intermediary between users and the annotation system. This database mediates the storage, retrieval, and sharing of annotation information, enabling collaborative editing and knowledge sharing while maintaining system organization. The database acts as a central repository that connects multiple users to the annotation functionality.
Data Source
AI summary
A terminal device, which can reduce a calculation amount for displaying an annotation text, an annotation method, a computer system, and a computer program.A plurality of annotation rules created for each window in which an annotation text is to be displayed are accumulated in an annotation DB, which of windows displayed on an operation screen is an active window is always monitored by a business screen state acquisition section, and when annotation display operation is performed by a user, an annotation display section obtains an annotation rule of an active window associated with the user's operation from the annotation DB and displays an annotation text included in the annotation rule on the operation screen.