Operation Display Apparatus Virtual Key Mapping for Overlapping Screens
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
When a portable terminal is placed close to an operating panel, it often covers hard or soft keys, making it impossible for users to operate the hidden buttons, as existing technologies do not effectively manage the overlap between the two screens.
Innovation Solution
An operation display apparatus with a position detecting unit, a free region detecting unit, and an operation control unit that displays images of hidden operating unit buttons in a free region on either the operating panel or portable terminal, allowing users to perform operations on these images as if they were operating the original buttons.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If the portable terminal is placed close to the operating panel for cooperative operation, then the user can view both screens at a time, but the portable terminal covers the hard keys and soft keys on the operating panel, making it impossible for the user to press or operate the hidden keys
Solution Approach 1:
The patent creates a virtual copy of the operating panel's keys and displays it on the portable terminal's screen. This virtual keyset mirrors the physical keys that are covered, allowing users to interact with the operating panel functions through the portable terminal's touchscreen interface when the physical keys are inaccessible.
Solution Approach 2:
The portable terminal acts as an intermediary device between the user and the operating panel. When the portable terminal is placed on the operating panel, it detects the position of covered keys and provides alternative interaction points on its own screen, mediating the user's access to the operating panel's functions without requiring direct contact with the covered physical keys.
2Loss of information
If the portable terminal is placed adjacent to the operating panel screen, then the user can view both screens simultaneously, but depending on the placement position, the portable terminal lies on top of the hard keys, making it impossible for the user to press the hard keys
Solution Approach 1:
The system creates a visual replica of the operating panel's key layout on the portable terminal's display. This copy includes all necessary keys and controls, allowing users to access full functionality through the portable terminal's screen even when the physical keys are covered or inaccessible.
Solution Approach 2:
The patent transitions the interaction interface from the two-dimensional physical key surface to another two-dimensional surface (the portable terminal's screen), which is positioned in a different spatial dimension relative to the user's hand. This dimensional shift allows simultaneous viewing of both screens while maintaining full operational capability through the virtual keyset.
3Adaptability or versatility
If the portable terminal is brought close to the operating unit, then cooperative operation is enabled, but the operating unit becomes hidden behind the portable terminal and cannot be operated by the user
Solution Approach 1:
The system generates a virtual representation of the operating unit's interface elements on the portable terminal's display. This virtual interface includes all necessary buttons, controls, and interaction points, enabling users to perform all operating unit functions through the portable terminal's touchscreen when the physical operating unit is covered.
Solution Approach 2:
The portable terminal serves multiple functions: it acts as both a display device for viewing content and as a control interface for operating the image processing apparatus. By integrating the virtual keyset and control interface directly on the portable terminal, the system enables a single device to fulfill both viewing and operational roles, maintaining full functionality regardless of the terminal's physical position.
Data Source
AI summary
An operation display apparatus includes: an operating unit; a display unit; a position detecting unit configured to detect a position of a predetermined portable terminal; a free region detecting unit configured to detect a free region on a display screen of at least one of the display unit and the portable terminal; and an operation control unit configured to display an image of the operating unit in the free region when the position of the portable terminal detected by the position detecting unit is in front of a front side of the operating unit, and accept an operation performed on the image, as an operation received by the operating unit, the free region being detected by the free region detecting unit.