Display Control Apparatus with Restricted Command Indicators
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a lack of technology that allows users to easily recognize commands whose execution is restricted when controlling another terminal using a recognition result of a screen subjected to display control.
Innovation Solution
The system includes an execution terminal and an operation terminal, where the operation terminal captures and recognizes the screen displayed by the execution terminal, and displays a restriction indicator for commands with restricted execution, enabling users to easily identify and interact with permitted commands while preventing unauthorized access to restricted ones.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If command execution control is implemented using a recognition result of a screen, then the control precision and automation are improved, but the user cannot easily recognize which commands are restricted
Solution Approach 1:
The patent applies color changes by displaying restricted commands in grayed-out text or with a different color appearance compared to executable commands. This visual differentiation allows users to easily distinguish between commands that can be executed and those that are restricted, resolving the contradiction between automated control and user recognition.
Solution Approach 2:
The patent introduces an intermediary visual indicator (such as a restriction icon, highlighted background, or special symbol) that mediates between the command list and the user. This intermediary element explicitly marks restricted commands without requiring the user to interpret the raw command structure, thereby improving ease of operation while maintaining automated control.
2Loss of information
If all command details are displayed to ensure complete information, then the information completeness is improved, but the interface complexity increases
Solution Approach 1:
The patent segments the command display into different visual categories: executable commands are displayed normally, while restricted commands are displayed with special visual markers. This segmentation allows users to quickly identify restricted commands without displaying all command details in full, thereby reducing interface complexity while maintaining information completeness about command status.
Solution Approach 2:
The patent applies local quality by providing different display characteristics for different command types. Restricted commands receive special local treatment (such as grayed-out appearance or icons) while executable commands maintain their normal appearance. This selective differentiation conveys necessary information without uniformly increasing complexity across the entire interface.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An information processing system that acquires captured image data corresponding to a user interface displayed on a first display, the user interface including a plurality of graphic representations each corresponding to a respective function; and controls a second display to display a representation of the user interface based on a recognition process performed on the user interface, the representation of the user interface indicating whether a function corresponding the plurality of the graphic representations is capable of being accessed.