Pen type interactive method based on free-hand sketch and gesture input judging and processing

Abstract

Provided is a pen type interactive method based on a free-hand sketch and gesture input judging and processing. Under the condition that a user keeps conducting inputting, the input state of the user can be automatically judged, and processing can be conducted according to different input states. The method defines no less than ten types of pen gestures including graphic object pickup class gestures, graphic object editing class gestures and operation state control class gestures, and part of the pen gestures and elements have semantic ambiguity definitions. In the process of judging and processing the input state, the pen gesture judging and processing method and the writing stopping processing method are designed, therefore, under the condition that no other interactive devices such as right click menus or mice or keys are involved, and a method for controlling graphic symbol free-hand sketch input, sketch editing and operation state does not need explicit state switching and is provided for the user so that the user can smoothly express interactive intention through pen type interaction. The method has certain universality and extendibility, can be applied to different professional fields, and achieves machine-aided design or military plotting and the like based on pen type interaction.

Description

technical field [0001] The invention belongs to the technical field of human-computer interaction, and specifically relates to a pen-type interaction method based on hand-drawn sketches and gesture input judgment processing. Background technique [0002] The traditional graphical user interface is based on the desktop metaphor, adopts the WIMP (Window, Icon, Menu, Pointing) interaction paradigm, and uses the mouse and keyboard as interactive devices to realize human-computer dialogue. Pen interaction is based on the metaphor of pen and paper. Through input devices such as writing pads and touch screens, it collects the user's input trajectory based on stylus or fingers, helping people to easily capture ideas, record events, perform abstract thinking and describe images. [0003] In the field of graphic-based interaction, pen-based interaction captures and understands user intent based on collected user input information, and maps it to the standard graphic symbol feedback di...

AI Technical Summary

Problems solved by technology

[0009] (1) Most of the research focuses on the recognition method of sketch graphic symbols, lack of research on interactive feedback mechanism and gesture interaction

[0010] (2) The design of the user interaction feedback mechanism is limited to the feedback prompts for the online recognition results of sketch symbols, and lacks the interaction feedback mechanism under the condition of ensuring the continuity of user input. design

[0011] (3) Gesture interaction is supported, but the types of gesture recognition are limited (<6 types), generally only include graphic object operation gestures, and WIMP gestures and pens are not provided at the same time Gesture interaction cannot meet the needs of users for graphic editing and operation state control during pen-based interaction

[0012] (4) The definition of pen gestures is strictly separated from the definition of primitives. Knowledge burden, affecting the recognition rate of basic graphics

Images