Touchscreen Manipulation Control Using Held Input and 3D Gesture Space
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing manipulation systems for devices like drones require a large touch screen and limited manipulation procedures, making it difficult to maintain contact, especially with small-sized touch panels, and restricting versatility and precision.
Innovation Solution
A program that generates and holds manipulation information based on contact interactions with a display device, allowing manipulation of a target device even when the instruction object is not physically touching the screen, by defining a spatial range for contact and using virtual controller images to enable various manipulation patterns across the screen.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a large touch screen is used for manipulation, then manipulation precision and ease of operation are improved, but device portability and spatial efficiency deteriorate
Solution Approach 1:
The patent extends the manipulation space from the two-dimensional screen surface to three-dimensional space by defining a spatial range (virtual manipulation area) around the display device. This allows users to perform swipe operations in the air within this spatial range, effectively adding a vertical dimension to the manipulation interface. The manipulation information generation unit detects the movement of the instruction object within this three-dimensional space and generates corresponding manipulation commands, thereby achieving precise control without requiring a large physical screen.
2Reliability
If continuous contact with the screen is required for manipulation, then control reliability is improved, but ease of operation deteriorates due to the need to maintain constant finger contact
Solution Approach 1:
The system establishes a virtual manipulation area in advance around the display device, within which the instruction object can move freely to generate manipulation commands. This preliminary setup eliminates the need for continuous screen contact, as the manipulation space is pre-defined in the spatial range. The manipulation information generation unit continuously monitors the position of the instruction object within this pre-established spatial range and generates corresponding manipulation commands, ensuring both reliability and ease of operation.
3Area of stationary object
If a small-sized touch panel is used, then device portability is improved, but manipulation precision and ease of operation deteriorate
Solution Approach 1:
The patent compensates for the limited screen size by extending the manipulation interface into three-dimensional space. The manipulation information generation unit defines a spatial range around the small display device where the instruction object can move to generate manipulation commands. This vertical spatial extension effectively multiplies the available manipulation area, allowing users to perform precise control operations without requiring a large physical screen, thereby maintaining manipulation precision while preserving device portability.
4Device complexity
If limited manipulation procedures are provided, then device complexity is reduced, but adaptability and versatility deteriorate
Solution Approach 1:
The patent implements a universal manipulation interface where the manipulation information generation unit can generate various types of manipulation commands (swipe, tap, long press, etc.) based on the movement patterns of the instruction object within the spatial range. The same basic mechanism of detecting instruction object movement and generating corresponding commands supports multiple manipulation procedures and different application scenarios, achieving high versatility without significantly increasing device complexity. The system adapts to different manipulation needs by interpreting different movement patterns within the established spatial range.
Data Source
AI summary
A program manipulates a device compatible with all sizes of devices such as a touch panel used for manipulation. The program is for manipulating a manipulation target device. The program causes a computer, that includes a display device that accepts a contact manipulation by an instruction object, to generate manipulation information, for manipulating the manipulation target device on the basis of a contact manipulation by the instruction object on the display device, to hold the manipulation information even when the instruction object is not touching the display device, and to manipulate the manipulation target device by transmitting the held manipulation information to the manipulation target device. The computer restarts generation of the manipulation information on the basis of the held current manipulation information when a contact on the display device is made again.