Pen type interactive method based on free-hand sketch and gesture input judging and processing

A judgment processing and gesture input technology, applied in the field of human-computer interaction, can solve the problems of limited types of gesture recognition, increase in the size of the basic graphics set, lack of interactive feedback mechanism, gesture interaction research, etc. Simplicity and the effect of improving interaction efficiency

Active Publication Date: 2013-11-20
NO 709 RES INST OF CHINA SHIPBUILDING IND CORP
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] (1) Most of the research focuses on the recognition method of sketch graphic symbols, lack of research on interactive feedback mechanism and gesture interaction
[0010] (2) The design of the user interaction feedback mechanism is limited to the feedback prompts for the online recognition results of sketch symbols, and lacks the interaction feedback mechanism under the condition of ensuring the continuity of user input. design
[0011] (3) Gesture interaction is supporte

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pen type interactive method based on free-hand sketch and gesture input judging and processing
  • Pen type interactive method based on free-hand sketch and gesture input judging and processing
  • Pen type interactive method based on free-hand sketch and gesture input judging and processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0061] see image 3 , Figure 4 , using "circular" input as an illustration example of the present invention to specifically illustrate the steps of method 300 and method 400:

[0062] (1) After the user's current input is completed, set a timer to judge whether the user's current input is a stroke input. If so, collect the current original stroke information and transfer to (3), otherwise transfer to (2);

[0063] (2) Cancel the timer, execute non-stroke input response, and transfer to (9);

[0064] (3) Determine whether the current stroke is a WIMP gesture, if so, perform WIMP gesture processing, cancel the timer, and turn to (9), otherwise turn to (4);

[0065] (4) Judging whether the length of the current stroke is less than a certain preset threshold, if so, perform pause processing, and turn to (9), otherwise turn to (5);

[0066] (5) Judging whether the current original stroke is a new stroke of a new sketch, if yes, turn to (6), otherwise turn to (7);

[0067] (6) ...

Embodiment 2

[0072] The steps of method 300 and method 400 are specifically described by using "polyline" input as another example of the present invention:

[0073] (1) After the user's current input is completed, set a timer to judge whether the user's current input is a stroke input. If so, collect the current original stroke information and transfer to (3), otherwise transfer to (2);

[0074] (2) Cancel the timer, execute non-stroke input response, and transfer to (9);

[0075] (3) Determine whether the current stroke is a WIMP gesture, if so, perform WIMP gesture processing, cancel the timer, and turn to (9), otherwise turn to (4);

[0076] (4) Judging whether the length of the current stroke is less than a certain preset threshold, if so, perform pause processing, and turn to (9), otherwise turn to (5);

[0077] (5) Judging whether the current original stroke is a new stroke of a new sketch, if yes, turn to (6), otherwise turn to (7);

[0078] (6) Obtain the original information of...

Embodiment 3

[0083] see image 3 , Figure 5 , each step of the method 300 and the method 500 is illustrated by taking the stroke input smaller than the preset threshold as another example.

[0084] (1) After the user's current input is completed, set a timer to judge whether the user's current input is a stroke input. If so, collect the current original stroke information and transfer to (3), otherwise transfer to (2);

[0085] (2) Cancel the timer, execute non-stroke input response, and transfer to (9);

[0086] (3) Determine whether the current stroke is a WIMP gesture, if so, perform WIMP gesture processing, cancel the timer, and turn to (9), otherwise turn to (4);

[0087] (4) Obtain the original stroke information, determine that the length of the current stroke is less than a preset threshold, and perform pause processing;

[0088] (5) Judge whether the current stroke is a new stroke of a new sketch, if so, go to (6), otherwise go to

[0089] enter(7);

[0090] (6) Determine wh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Provided is a pen type interactive method based on a free-hand sketch and gesture input judging and processing. Under the condition that a user keeps conducting inputting, the input state of the user can be automatically judged, and processing can be conducted according to different input states. The method defines no less than ten types of pen gestures including graphic object pickup class gestures, graphic object editing class gestures and operation state control class gestures, and part of the pen gestures and elements have semantic ambiguity definitions. In the process of judging and processing the input state, the pen gesture judging and processing method and the writing stopping processing method are designed, therefore, under the condition that no other interactive devices such as right click menus or mice or keys are involved, and a method for controlling graphic symbol free-hand sketch input, sketch editing and operation state does not need explicit state switching and is provided for the user so that the user can smoothly express interactive intention through pen type interaction. The method has certain universality and extendibility, can be applied to different professional fields, and achieves machine-aided design or military plotting and the like based on pen type interaction.

Description

technical field [0001] The invention belongs to the technical field of human-computer interaction, and specifically relates to a pen-type interaction method based on hand-drawn sketches and gesture input judgment processing. Background technique [0002] The traditional graphical user interface is based on the desktop metaphor, adopts the WIMP (Window, Icon, Menu, Pointing) interaction paradigm, and uses the mouse and keyboard as interactive devices to realize human-computer dialogue. Pen interaction is based on the metaphor of pen and paper. Through input devices such as writing pads and touch screens, it collects the user's input trajectory based on stylus or fingers, helping people to easily capture ideas, record events, perform abstract thinking and describe images. [0003] In the field of graphic-based interaction, pen-based interaction captures and understands user intent based on collected user input information, and maps it to the standard graphic symbol feedback di...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/0487G06K9/00
Inventor 李恒邵宏峰熊毅
Owner NO 709 RES INST OF CHINA SHIPBUILDING IND CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products