Remote Image Forming Control via Panel Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image forming systems require users to install specific layout data for each model of the image forming apparatus on mobile terminal devices, making it inconvenient for users to operate different models without physical interaction, which can lead to infection risks from contact.

Innovation Solution

A system where a mobile terminal apparatus captures and displays an image of the image forming apparatus's operation panel, detects user operations, extracts a partial image of the operation area, and transmits this data to the image forming apparatus, allowing it to identify and execute corresponding actions without needing pre-installed layout data, thus enabling operation across various models without direct user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If layout data for each model is pre-installed on mobile terminal devices, then operation accuracy is improved, but device complexity and user burden increase

Engineering Contradiction:
Improveoperation accuracyVSAvoidlayout data management complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The invention captures the actual operation panel display as an image and uses this visual copy for remote operation, eliminating the need for pre-installed layout data. The captured image serves as a dynamic template that automatically adapts to different device models and software versions.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system automatically captures the operation panel state and generates the necessary operation template without requiring user intervention for data installation or configuration. The mobile terminal autonomously adapts to different image forming apparatus models.

Inventive Principle:
Principle #25Self-service

2Reliability

If physical contact with operation panel is required, then operation reliability is improved, but infection risk increases

Engineering Contradiction:
Improveoperation reliabilityVSAvoidinfection risk
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The invention introduces a mobile terminal as an intermediary device that captures images of the operation panel and transmits operation commands remotely. This mediator eliminates direct physical contact between the user and the image forming apparatus while maintaining operational reliability through visual feedback and precise touch input mapping.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If model-specific layout data is required, then operation precision is improved, but adaptability decreases

Engineering Contradiction:
Improveoperation precisionVSAvoidcross-model compatibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The invention creates a universal remote operation system that works across different image forming apparatus models by using captured operation panel images as the basis for generating model-specific operation templates dynamically, rather than requiring pre-configured model-specific data.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The operation template is dynamically generated based on the captured operation panel state, allowing the system to adapt to different models, software versions, and display configurations in real-time without requiring static pre-installed data for each model.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11722611B2Image forming system capable of remotely operating image forming apparatus, image forming apparatus, and remote operation program
Publication Date: 2023.08.08 KYOCERA DOCUMENT SOLUTIONS INC
  • US11722611B2 patent drawing
  • US11722611B2 patent drawing
  • US11722611B2 patent drawing

AI summary

An image forming system includes a mobile terminal apparatus and an image forming apparatus. The mobile terminal apparatus displays a captured image of an operation panel of the image forming apparatus, extracts from the captured image, in response to a user operation on the captured image, an operation partial image including an operation part designated by the user operation, and transmits operation partial image data indicating the operation partial image to the image forming apparatus. The image forming apparatus identifies the operation part corresponding to the operation partial image data received from the mobile terminal apparatus, and executes an action corresponding to the identified operation part.