Remote Operation Panel Control via Captured Image Position Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image forming systems require users to install specific layout data on mobile terminal devices for each model of image forming apparatus, making it inconvenient for users to perform operations across different models without physical interaction, which can lead to infection risks from contact.
Innovation Solution
The system allows mobile terminal devices to capture and transmit image data and operation position data to the image forming apparatus, enabling remote operation by identifying relative positions on the operation panel and executing corresponding actions without pre-installed layout data, thus allowing operations across various models without physical contact.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If layout data is pre-installed on mobile terminal devices for each model of image forming apparatus, then remote operation can be performed, but users must install different layout data for each model which reduces ease of operation
Solution Approach 1:
The system captures an image of the operation panel display and transmits it to the mobile terminal device. The captured image serves as a digital copy of the operation panel, allowing users to interact with it remotely without needing pre-installed layout data for each device model.
Solution Approach 2:
The image forming apparatus automatically captures and transmits its own operation panel display to the mobile terminal device. This self-service mechanism eliminates the need for users to manually install or configure layout data, as the system provides the necessary interface information automatically.
2Object-affected harmful factors
If physical interaction with the operation panel is required, then precise operations can be performed, but infection risks from contact increase
Solution Approach 1:
The system introduces a captured image of the operation panel as an intermediary between the user and the actual operation panel. Users interact with the captured image displayed on their mobile terminal device, which then transmits operation commands to the image forming apparatus, eliminating the need for direct physical contact with the operation panel.
3Adaptability or versatility
If remote operation is implemented without pre-installed layout data, then ease of operation improves, but difficulty of detecting and measuring operation positions increases
Solution Approach 1:
The system transmits a captured image of the operation panel display to the mobile terminal device, providing a visual copy that maintains the spatial relationships and positions of all display elements. This allows users to accurately identify operation positions on the captured image without needing pre-installed layout data, as the visual representation preserves the original positioning information.
Data Source
AI summary
An image forming system includes a mobile terminal apparatus and an image forming apparatus. The mobile terminal apparatus displays a captured image of an operation panel of the image forming apparatus and transmits, in response to a user operation on the captured image, captured image data indicating the captured image and operation position data indicating a position of the user operation to the image forming apparatus. Based on the captured image data and the operation position data received from the mobile terminal apparatus, the image forming apparatus identifies an indirectly operated part of the operation panel, and executes an action corresponding to the identified part.


