Mobile Terminal Remote Control for MFPs via Image Coordinate Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote control systems for multi-function peripherals (MFPs) require individual function setups for each MFP and updates, making them inflexible and cumbersome.
Innovation Solution
A communication terminal system with a display, input device, and communication capabilities that receives instruction image data, identifies input events, and transmits coordinate information to a processing apparatus, allowing versatile control of MFPs regardless of image size changes, eliminating the need for specific setups or updates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If remote control function is created for each MFP with specific setups, then the MFP can be controlled accurately, but the system complexity increases and requires updates when MFP functions change
Solution Approach 1:
The patent captures the display image of the MFP operation unit and transmits it to the mobile terminal. Instead of creating complex control functions for each MFP, the system copies the visual representation of the MFP interface and uses image recognition to map touch inputs to corresponding MFP operations, significantly reducing system complexity while maintaining control accuracy
Solution Approach 2:
The patent introduces an image processing intermediary layer between the mobile terminal and MFP. The display image capture unit, coordinate conversion unit, and operation determination unit act as mediators that translate touch coordinates on the mobile terminal screen to corresponding MFP operations without requiring direct integration with each MFP's control system
2Adaptability or versatility
If the display image is scaled to fit different screen sizes, then the system adapts to various terminals, but coordinate accuracy deteriorates
Solution Approach 1:
The patent dynamically changes the scaling parameter based on the mobile terminal's screen resolution and the captured image dimensions. The coordinate conversion unit applies different scaling factors to map touch coordinates accurately regardless of screen size, maintaining coordinate precision while adapting to various display resolutions
Solution Approach 2:
The patent solves the coordinate accuracy problem by working in the image coordinate system rather than physical screen dimensions. The coordinate conversion unit transforms touch coordinates from the displayed image coordinate system to the original MFP operation coordinate system, effectively handling different screen sizes without losing precision
3Ease of operation
If the mobile terminal displays the MFP operation unit image, then user familiarity is maintained, but the function requires individual setup for each MFP
Solution Approach 1:
The patent implements self-service functionality where the mobile terminal automatically captures the MFP display image, processes it through coordinate conversion, and determines operations without requiring manual configuration. The system adapts to different MFPs automatically by capturing their unique display images and converting coordinates based on the captured image dimensions
Solution Approach 2:
The patent creates a universal remote control solution that works with different MFP models without requiring model-specific setup. The system uses generic image capture and coordinate conversion mechanisms that adapt to any MFP's display, eliminating the need for individual function setups while maintaining ease of operation
Data Source
AI summary
A non-transitory storage medium stores instructions executable by a communication terminal including a display and an input device for detecting an instructed point on the display. The instructions cause the communication terminal to: receive, from a processing apparatus, instruction image data for displaying an instruction image for instructing the processing apparatus to execute a processing; display the instruction image; and transmit, to the processing apparatus, an input event on the input device and coordinate information about the instructed point detected with the instruction image being displayed. The coordinate information is based on: standard-size positional information for indentifying a location of the instructed point when the instruction image is of a standard size; and a location of the instructed point on the display regardless of whether a size of an instruction image being displayed on the display is increased or reduced.