Remote Operation Panel Control via Captured Image Position Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image forming systems require users to install specific layout data on mobile terminal devices for each model of image forming apparatus, making it inconvenient for users to perform operations across different models without physical interaction, which can lead to infection risks from contact.

Innovation Solution

The system allows mobile terminal devices to capture and transmit image data and operation position data to the image forming apparatus, enabling remote operation by identifying relative positions on the operation panel and executing corresponding actions without pre-installed layout data, thus allowing operations across various models without physical contact.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If layout data is pre-installed on mobile terminal devices for each model of image forming apparatus, then remote operation can be performed, but users must install different layout data for each model which reduces ease of operation

Engineering Contradiction:
Improveease of remote operationVSAvoidcomplexity of layout data installation
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system captures an image of the operation panel display and transmits it to the mobile terminal device. The captured image serves as a digital copy of the operation panel, allowing users to interact with it remotely without needing pre-installed layout data for each device model.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The image forming apparatus automatically captures and transmits its own operation panel display to the mobile terminal device. This self-service mechanism eliminates the need for users to manually install or configure layout data, as the system provides the necessary interface information automatically.

Inventive Principle:
Principle #25Self-service

2Object-affected harmful factors

If physical interaction with the operation panel is required, then precise operations can be performed, but infection risks from contact increase

Engineering Contradiction:
Improveinfection risk from contactVSAvoidability to perform operations
Core Design Contradiction:
Object-affected harmful factorsVSEase of operation

Solution Approach 1:

The system introduces a captured image of the operation panel as an intermediary between the user and the actual operation panel. Users interact with the captured image displayed on their mobile terminal device, which then transmits operation commands to the image forming apparatus, eliminating the need for direct physical contact with the operation panel.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If remote operation is implemented without pre-installed layout data, then ease of operation improves, but difficulty of detecting and measuring operation positions increases

Engineering Contradiction:
Improvecompatibility across different modelsVSAvoiddifficulty of identifying operation positions
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system transmits a captured image of the operation panel display to the mobile terminal device, providing a visual copy that maintains the spatial relationships and positions of all display elements. This allows users to accurately identify operation positions on the captured image without needing pre-installed layout data, as the visual representation preserves the original positioning information.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11870965B2Image forming system capable of receiving and transmitting captured image with operation position data and further remotely operating image forming apparatus, and image forming apparatus
Publication Date: 2024.01.09 KYOCERA DOCUMENT SOLUTIONS INC
  • US11870965B2 patent drawing
  • US11870965B2 patent drawing
  • US11870965B2 patent drawing

AI summary

An image forming system includes a mobile terminal apparatus and an image forming apparatus. The mobile terminal apparatus displays a captured image of an operation panel of the image forming apparatus and transmits, in response to a user operation on the captured image, captured image data indicating the captured image and operation position data indicating a position of the user operation to the image forming apparatus. Based on the captured image data and the operation position data received from the mobile terminal apparatus, the image forming apparatus identifies an indirectly operated part of the operation panel, and executes an action corresponding to the identified part.