Pen type interactive method based on free-hand sketch and gesture input judging and processing

Abstract

Provided is a pen type interactive method based on a free-hand sketch and gesture input judging and processing. Under the condition that a user keeps conducting inputting, the input state of the user can be automatically judged, and processing can be conducted according to different input states. The method defines no less than ten types of pen gestures including graphic object pickup class gestures, graphic object editing class gestures and operation state control class gestures, and part of the pen gestures and elements have semantic ambiguity definitions. In the process of judging and processing the input state, the pen gesture judging and processing method and the writing stopping processing method are designed, therefore, under the condition that no other interactive devices such as right click menus or mice or keys are involved, and a method for controlling graphic symbol free-hand sketch input, sketch editing and operation state does not need explicit state switching and is provided for the user so that the user can smoothly express interactive intention through pen type interaction. The method has certain universality and extendibility, can be applied to different professional fields, and achieves machine-aided design or military plotting and the like based on pen type interaction.

Description

technical field

[0001] The invention belongs to the technical field of human-computer interaction, and specifically relates to a pen-type interaction method based on hand-drawn sketches and gesture input judgment processing. Background technique

[0002] The traditional graphical user interface is based on the desktop metaphor, adopts the WIMP (Window, Icon, Menu, Pointing) interaction paradigm, and uses the mouse and keyboard as interactive devices to realize human-computer dialogue. Pen interaction is based on the metaphor of pen and paper. Through input devices such as writing pads and touch screens, it collects the user's input trajectory based on stylus or fingers, helping people to easily capture ideas, record events, perform abstract thinking and describe images.

[0003] In the field of graphic-based interaction, pen-based interaction captures and understands user intent based on collected user input information, and maps it to the standard graphic symbol feedback di...

Images