Gesture-Based Document Editor for Mobile Touch Screens
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current pen-based text editing systems on mobile devices are inefficient due to the full screen user interface, which makes operations like text selection, deletion, copying, and pasting difficult, requiring users to switch to a box-based interface or perform character-by-character editing.
Innovation Solution
A gesture-based method where users form a first path to select an object on a touch screen by partially enclosing it, and a second path at a predetermined area to activate editing operations, using a device with a display processor, touch screen, input detection units, and an editing unit to recognize and execute these gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a full screen user interface is adopted to maximize writing area, then the area for text input is improved, but the ease of performing text editing operations deteriorates
Solution Approach 1:
A selection indicator (visual intermediary element) is introduced to mediate between the user's drawing gesture and the text selection function. The indicator follows the user's stroke and visually indicates selected text, enabling intuitive selection without disrupting the natural handwriting flow or requiring mode switching.
Solution Approach 2:
The text editing functionality is segmented into distinct gesture-based operations: a first type of stroke for text selection and a second type of stroke for triggering editing functions. This segmentation allows each gesture type to be recognized and processed independently, enabling efficient text manipulation directly in the writing area.
2Device complexity
If traditional character-by-character pen editing is used, then the device complexity is reduced, but the productivity deteriorates
Solution Approach 1:
The system performs preliminary recognition of the user's drawing stroke to identify selection regions before the actual editing operation is executed. The selection indicator is displayed in advance to confirm the selected text, allowing users to make corrections or adjustments before finalizing the editing action.
Solution Approach 2:
Traditional mechanical keyboard-based text editing is replaced with gesture-based pen input recognition. The system substitutes physical key presses with graphical stroke recognition, enabling users to perform text selection and editing operations directly with pen gestures on the touch screen.
3Ease of operation
If users switch to a box-based user interface for text editing, then the ease of text selection and editing operations is improved, but the device complexity increases
Solution Approach 1:
The touch screen interface is designed to be universal, supporting both natural handwriting input and text editing operations within the same full-screen writing area. The system recognizes different types of strokes in the same space, eliminating the need for separate box-based editing interfaces while maintaining ease of text manipulation.
Data Source
Figure 1
Figure 2~3(b)
Figure 4(a)~4(g)
AI summary
A method for editing objects on a device comprising forming a first path on a touch screen with a pointing device. The first path at least partially encloses an object. The at least partially enclosed object is automatically selected. A second path is formed at a predetermined area on the touch screen with the pointing device. The second path activates an editing operation.