Gesture-Based Program Editing for Touch Panels

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The conventional method of using a touch panel for program editing in engineering tools is cumbersome due to the large hand movement required for designating program elements, leading to reduced screen information density compared to mouse-based operations.

Innovation Solution

A program that acquires input gesture characteristic information, such as coordinate and track direction, to specify operation targets and execute commands on a program editing screen, allowing simultaneous designation of targets and commands through gesture-based input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the conventional general method is used for touch panel operation, then the operation method is simple and consistent with mouse operation, but the moving distance of hand is large and the operation is onerous

Engineering Contradiction:
Improveoperation method consistencyVSAvoidhand moving distance
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent replaces the mechanical pointing system (mouse cursor movement) with a direct touch system where the finger itself becomes the pointer. The touch position on the screen directly corresponds to the operation target, eliminating the need for hand movement between the finger and screen. This substitution fundamentally changes the interaction model from indirect (mouse) to direct (touch), resolving the contradiction between operational simplicity and efficiency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If the finger is larger than a mouse pointer, then the touch input is easier, but a list of choices needs to be displayed large on the screen causing reduction of information display

Engineering Contradiction:
Improvetouch input easeVSAvoidscreen information density
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent extracts the command selection functionality from the screen display and implements it through gesture recognition. Instead of displaying command lists on the screen that consume valuable display space, the system recognizes gestures performed by the user and automatically determines the intended command. This extraction eliminates the need for large on-screen command lists while preserving easy touch input, as the finger size advantage is maintained for target selection without sacrificing screen real estate for command displays.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces gesture recognition as an intermediary between touch input and command execution. Rather than directly mapping touch position to command selection (which would require on-screen command lists), the system uses gesture patterns as an intermediate layer. The gesture recognition system interprets the user's intent based on movement patterns, eliminating the need for visible command lists while maintaining intuitive touch-based interaction.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If command lists are displayed on the program editing screen, then command selection is straightforward, but the screen information density is reduced

Engineering Contradiction:
Improvecommand selection easeVSAvoidscreen information display area
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent replaces the visual command list interface with a gesture-based command selection system. Instead of requiring users to visually scan and select commands from on-screen lists, the system recognizes gesture patterns to automatically determine the intended command. This substitution eliminates the need for command lists on the screen, maximizing the available display area for program editing while maintaining intuitive command selection through natural hand movements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9910643B2Program for program editing
Publication Date: 2018.03.06 MITSUBISHI ELECTRIC CORP
  • US9910643B2 patent drawing
  • US9910643B2 patent drawing
  • US9910643B2 patent drawing

AI summary

A program for program editing for editing a program described using a symbol on a program editing screen causes an information processing apparatus to function as input-gesture-characteristic-information acquiring unit for acquiring input gesture characteristic information including coordinate information and a track of the coordinate input on the program editing screen, and as processing executing unit for specifying an operation target and specifying a command applied to the operation target on the basis of the input gesture characteristic information, executing the command, and for displaying the result of execution of the command on the program editing screen.