Portable Terminal Screen Region Extraction for Image Forming Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in easily viewing and operating application screens on image forming apparatus displays due to varying screen sizes of portable terminals, leading to intricate operations when sharing screens between portable terminals and image forming apparatuses.

Innovation Solution

An information processing system that determines the presence of an operation-receiving region on the portable terminal's screen and extracts the corresponding operating region, then displays it on the image forming apparatus in a larger format, maintaining the aspect ratio to facilitate user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the application screen from a portable terminal is displayed on the image forming apparatus display, then the user can operate the application through the image forming apparatus, but the screen elements become too small to easily view and operate due to size reduction

Engineering Contradiction:
Improvescreen sharing capabilityVSAvoidoperability of displayed screen
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent divides the portable terminal screen into multiple regions: a full screen image display region and an operating region display region. The operating region (containing buttons, input fields, and interactive elements) is extracted and displayed separately in a magnified format on the image forming apparatus display, while the full screen image provides contextual background. This segmentation allows users to easily view and interact with screen elements without sacrificing the overall screen sharing functionality.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If the entire application screen is displayed on the image forming apparatus, then the user can see the full context, but the operating elements become difficult to distinguish and interact with

Engineering Contradiction:
Improvecontextual information visibilityVSAvoidvisibility of operating elements
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies local quality by giving different display treatments to different parts of the screen. The operating region (containing interactive elements like buttons and input fields) is displayed with enhanced size and prominence in a dedicated operating region display area, while the rest of the screen content is shown at normal scale in the full screen image display region. This allows contextual information to remain visible while making operating elements easily detectable and measurable.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10725724B2Information processing system, method of controlling information processing system, and portable terminal
Publication Date: 2020.07.28 KONICA MINOLTA INC
  • US10725724B2 patent drawing
  • US10725724B2 patent drawing
  • US10725724B2 patent drawing

AI summary

An information processing system including an image forming apparatus and a portable terminal that is allowed to communicate with the image forming apparatus, includes a hardware processor that: determines whether a cooperative screen for cooperating with the image forming apparatus includes an operation-receiving region for receiving an operation by a user, the cooperative screen being displayed on a display of the portable terminal; extracts, from the cooperative screen, an image corresponding to an operating region including the operation-receiving region when the hardware processor determines that the cooperative screen includes the operation-receiving region; and displays, on a display of the image forming apparatus, the image corresponding to the operating region extracted by the hardware processor.