Annotation Apparatus for External Program Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing job systems face difficulties in seamlessly integrating with external programs due to challenges in calling external programs from annotation objects, particularly in coordinating with GUIs and providing job knowledge in a format that aligns with actual operations on a 2D screen.
Innovation Solution
An annotation apparatus and method that includes a storage for annotation objects and rules, an identifier for active windows, and a caller that executes external programs based on associated annotation rules when the annotation object is selected, facilitating easy integration with external programs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If an API is provided for the job system to directly describe GUI display images, then the automation capability is improved, but the user must understand each individual API and set adapters for different job systems, reducing versatility
Solution Approach 1:
The annotation object serves multiple functions: it displays job knowledge information and simultaneously acts as a trigger to call external programs. This multi-functionality eliminates the need for separate adapter mechanisms for different job systems, as the annotation object works universally across different applications and windows.
Solution Approach 2:
The annotation object acts as an intermediary between the GUI display and external programs. Instead of requiring direct API integration between job systems and external programs, the annotation object mediates by detecting user selection and automatically invoking the appropriate external program, thus simplifying the interaction model.
2Quantity of substance
If text or wiki is used to accumulate job knowledge, then knowledge storage is achieved, but it becomes difficult to describe timing for referring to job knowledge in sync with application window transitions
Solution Approach 1:
The annotation object adds a spatial dimension to job knowledge by displaying it directly on the GUI screen at relevant positions. This spatial anchoring allows the knowledge to be automatically associated with the correct application window and timing, eliminating the need for manual timing descriptions in text or wiki formats.
Solution Approach 2:
The system provides feedback by monitoring which application window is currently active and automatically updating or displaying the corresponding annotation objects. This feedback mechanism ensures that job knowledge is always synchronized with the current application context without requiring manual intervention.
3Quantity of substance
If job knowledge is converted to primary information such as text, then knowledge can be stored, but the job system encounters difficulty in providing job knowledge in a format that provides a link with actual operation on a 2D screen
Solution Approach 1:
The annotation object transforms text-based job knowledge into a spatially-anchored visual element that is directly overlaid on the 2D screen. This allows the knowledge to maintain its textual information content while gaining a spatial relationship with the actual GUI elements it describes, enabling direct linkage between knowledge and screen operation.
4Ease of operation
If annotation objects are displayed on operation screen images, then information presentation is improved, but calling external programs from the annotation object is difficult
Solution Approach 1:
The annotation object merges the information display function with the program invocation function into a single interactive element. When the user selects the annotation object, it simultaneously serves as both the information source and the trigger for calling the external program, eliminating the need for separate mechanisms.
Solution Approach 2:
The annotation object is self-sufficient by containing or associating with the necessary information to call the external program. When selected, it automatically performs the program invocation without requiring additional configuration or separate control mechanisms, thus enabling easy external program integration.
Data Source
AI summary
An annotation apparatus includes an annotation DB, a screen state acquisition monitor unit, and an external collaboration program call unit. The annotation DB stores therein an annotation object and an annotation rule applicable to each of windows of the annotation object in an associated manner. The screen state acquisition monitor unit identifies an active window from among the windows. The external collaboration program call unit calls, when an annotation rule associated with the active window that has been identified by the screen state acquisition monitor unit is present in the annotation DB and when the annotation object is selected, an external program in accordance with the annotation rule.