Portable Terminal Image Overlay for MFP Function Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users find it difficult to operate complex image processing apparatuses like MFPs due to complicated operations, especially when they are less familiar with the devices or use different types, and there is a desire to utilize portable terminals that are more familiar to them for easier operation.

Innovation Solution

An image processing system that includes a portable terminal with a shooting unit, an obtaining unit for positional and orientation information, a display unit, and an input unit, which communicates with an image processing apparatus to detect the apparatus, combine image data with functional options, and allow users to select and execute functions through the portable terminal.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If image processing apparatuses are made more sophisticated with more functions, then functionality and capability are improved, but operation complexity increases making it difficult for users to recognize and use available functions

Engineering Contradiction:
ImprovefunctionalityVSAvoidoperation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

A portable terminal serves as an intermediary device between the user and the image processing apparatus. The terminal captures images of the apparatus, retrieves functional information from a server, and displays combined images showing the apparatus with overlaid function icons. This mediator simplifies the interaction by presenting complex functions in an intuitive visual format that users can easily understand and select.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a visual copy or representation of the image processing apparatus by capturing its image and overlaying functional information on it. This combined image serves as a simplified model that displays available functions directly on the apparatus image, allowing users to recognize and select functions without navigating complex menus or understanding the apparatus's internal complexity.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If users are required to learn complex operations for different image processing apparatuses, then comprehensive control capability is improved, but ease of operation deteriorates especially for infrequent users

Engineering Contradiction:
Improvecontrol capabilityVSAvoidease of use
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system enables users to operate image processing apparatuses without prior learning or training. By capturing an image of the specific apparatus and automatically retrieving its functional information, the system provides self-service operation where users can immediately understand and control the apparatus through the displayed combined image, eliminating the need to learn complex operations for different device types.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary actions by automatically capturing the apparatus image, retrieving functional information from the server, and preparing the combined image display before the user needs to operate any function. This pre-prepared visual interface allows users to immediately see available functions and proceed with operation without needing to learn or search for controls.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If traditional operation interfaces are used on image processing apparatuses, then direct control is improved, but accessibility for users familiar with portable terminals deteriorates

Engineering Contradiction:
Improvedirect controlVSAvoiduser accessibility
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The portable terminal serves multiple functions: it captures images of the apparatus, communicates with the server to retrieve functional information, displays combined images, and transmits operation instructions. This universal device that users already possess and are familiar with replaces the need for specialized apparatus interfaces, making the system accessible to all portable terminal users regardless of their familiarity with specific image processing equipment.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9128644B2Image processing system including an image processing apparatus and a portable terminal
Publication Date: 2015.09.08 KONICA MINOLTA INC
  • US9128644B2 patent drawing
  • US9128644B2 patent drawing
  • US9128644B2 patent drawing

AI summary

The position and orientation at a time of shooting by a shooting unit of a portable terminal is transmitted to an information processing apparatus. Based on the transmitted position and orientation of the portable terminal and the stored position of an image processing apparatus, the information processing apparatus extracts an image processing apparatus from the shot image and transmits information about the extracted image processing apparatus to the portable terminal. The portable terminal combines the shot image with an option for selecting a function available in the image processing apparatus and displays the combined image on a display unit, based on the information transmitted from the information processing apparatus. When selection of a function is accepted, a screen for operating the selected function is displayed on the display unit of the portable terminal.