Portable Terminal Gesture Handling for Remote Screen Responsiveness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing cooperative image processing systems between portable terminal apparatuses and image processing apparatuses face issues with responsiveness and operability during gesture operations like scaling and rotation due to continuous data transmission and poor wireless communication states, leading to inefficient handling of editorial processing on remote screens.

Innovation Solution

A portable terminal apparatus with a wireless communication portion, receiving, display, touch operation, and control portions that determine whether a gesture operation is performed on a first or second screen area, allowing for local processing and transmission of editorial processing instructions to the image processing apparatus based on communication state and attribute information, ensuring smooth and responsive screen updates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If editorial processing is performed by transmitting instructions to the image processing apparatus for the entire screen area, then image quality is maintained, but responsiveness deteriorates during gesture operations

Engineering Contradiction:
Improveimage qualityVSAvoidresponsiveness
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The screen area is divided into a first screen area and a second screen area. The controller determines whether a gesture operation is performed on the first or second screen area and performs editorial processing differently for each area, enabling selective local processing to improve responsiveness while maintaining image quality where needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different processing qualities are applied to different screen areas based on the gesture operation location. The first screen area receives full editorial processing from the image processing apparatus to maintain high image quality, while the second screen area uses simplified processing to improve responsiveness during gesture operations.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If screen data is transmitted continuously during gesture operations, then image quality is maintained, but communication efficiency deteriorates

Engineering Contradiction:
Improveimage qualityVSAvoidcommunication efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The controller extracts and identifies the specific screen area where the gesture operation is performed. Based on this extracted information, it selectively transmits editorial processing instructions only for the relevant screen area to the image processing apparatus, rather than continuously transmitting data for the entire screen, thereby improving communication efficiency.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The controller preliminarily determines the screen area affected by the gesture operation before transmitting editorial processing instructions. This preliminary identification allows the system to prepare and transmit only the necessary data for processing, reducing unnecessary communication overhead and improving efficiency.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If the image processing apparatus processes editorial operations for all screen areas, then processing accuracy is maintained, but device complexity increases

Engineering Contradiction:
Improveprocessing accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system dynamically adjusts the processing responsibility between the portable terminal apparatus and the image processing apparatus based on the gesture operation location. The controller determines in real-time whether to perform editorial processing locally or transmit instructions to the image processing apparatus, making the system flexible and adaptive rather than statically complex.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The portable terminal apparatus performs editorial processing itself for the second screen area where gesture operations occur, rather than always relying on the image processing apparatus. This self-service capability reduces the processing burden on the image processing apparatus and simplifies the overall system architecture.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9606755B2Portable terminal apparatus, cooperative image processing system, method for displaying screen data, and recording medium
Publication Date: 2017.03.28 KONICA MINOLTA INC
  • US9606755B2 patent drawing
  • US9606755B2 patent drawing
  • US9606755B2 patent drawing

AI summary

A portable terminal apparatus comprising: a display for a remote screen of the image processing apparatus; an acquisition portion for acquiring information indicating whether an area in the remote screen is a first area which is set for editorial processing by the portable terminal apparatus or a second area which is set for editorial processing by the image processing apparatus; a determination portion for determining whether a gesture operation is an operation performed on the first area or on the second area; and a control portion for performing the editorial processing with screen data of the first area if the operation was performed on the first area, and for transmitting information instructing the image processing apparatus to perform the editorial processing of screen data of the second area and acquiring the editorial processed screen data, if the operation was performed on the second image area.