Video handwriting character inputting device and method thereof

Abstract

The invention relates to a video handwriting character inputting device and a method thereof. The device comprises an image capturing unit, an image processing unit, a one-dimensional characteristic encoding unit, a character database storing Chinese, English, numbers and symbols, a character identifying unit and a display unit. The method comprises the following steps that: the image capturing unit captures an image; the image processing unit filters a motion track of a fingertip in the image by performing difference detection and then skin color detection on the image and selecting the motion track which is best matched with a point of a target object; the one-dimensional characteristic encoding unit extracts strokes of the motion track and converting the strokes into a one-dimensional serial encoding sequence according to a time sequence; and the character identifying unit compares the characters in the one-dimensional serial encoding and the character database, finds the characters with the highest similarity degree and outputs the found characters on the display unit.

Description

technical field [0001] The invention relates to a character input device, especially a handwritten character input device suitable for video communication. Background technique [0002] In recent years, with the rapid development of science and technology, almost all electronic products are developing in the direction of light weight, small size and strong functionality, such as personal digital assistants, mobile phones, notebook computers, etc. Devices such as handwriting pads, keyboards, mice, and joysticks are difficult to combine with larger devices, and the purpose of portability is greatly reduced. Therefore, how to conveniently input information to portable electronic products has become an important issue. question. [0003] In order to allow the general public to input information conveniently, research on many human-computer interaction interfaces is booming. The most convenient method is to directly use gestures to operate the computer and use fingertips to inpu...

AI Technical Summary

Problems solved by technology

[0002] In recent years, with the rapid development of science and technology, almost all electronic products are developing in the direction of light weight, small size and strong functionality, such as personal digital assistants, mobile phones, notebook computers, etc. Devices such as handwriting pads, keyboards, mice, and joysticks are difficult to combine with larger devices, and the purpose of portability is greatly reduced. Therefore, how to conveniently input information to portable electronic products has become an important issue. question

[0003] In order to allow the general public to input information conveniently, research on many human-computer interaction interfaces is booming. The most convenient method is to directly use gestures to operate the computer and use fingertips to input text. For the sharp position, a Glove-Based method has been proposed, which uses a data glove (DataGlove) equipped with sensors, which can accurately obtain a lot of information about the user's gestures, including finger contact, bending The advantage is that accurate gesture information can be obtained, but the disadvantage is that the cost is high and the range of motion is limited. Carrying this device on the hand for a long time will also cause a burden to the user.

[0004] Another vision-based method can be subdivided into two categories: one is the model-based method, and the other is the method based on the shape information of the appearance contour. The model-based method is to use two The above camera captures the hand movement, and then calculates the position of the hand in 3D space, and then compares it with the 3D model established in advance to know the current gesture movement or fingertip position, but this method requires a lot of calculation and is difficult to do. For real-time applications, the most commonly used method is based on the shape information of the appearance contour, which is to use a single camera to shoot hand movements, then cut out the information of the edge or shape of the hand, and then make gestures based on this information Identifying or judging the position of the fingertip, because this method has a low amount of calculation and the effect is good, it has become the most commonly used method at present

[0005] After obtaining the gesture information or the trajectory of handwritten text, it is necessary to perform gesture or handwritten text recognition. There are three common methods: hidden Markov model (Hidden MarkovModel), neural network (Neural Network) and dynamic time warping Algorithm (Dynamic timewarp matching algorithm), in which the recognition rate of dynamic time warp algorithm is higher, but it takes a long time

Images