A system and method for handwriting recognition in the air based on machine vision

Abstract

The invention discloses a system and method for recognizing handwriting in the air based on machine vision. The handwritten character video input part is used to collect and input the handwritten character video in the air with a specific color in real time and generate a trajectory picture from the collected trajectory points; the preprocessing part uses It is used to perform filtering, grayscale binarization, and morphological preprocessing operations on the trajectory image generated by the trajectory point; the character segmentation part is used to convert the RGB color space of the preprocessed trajectory point generated trajectory image into HSV, and use GA‑ The Otsu segmentation algorithm segments the characters in the HSV; the feature extraction part extracts the features of the segmented characters; the classification recognition part is used to use the particle swarm optimization algorithm PSO to optimize the support vector machine algorithm SVM to obtain the optimal SVM classification model. Output the recognition results for all characters. The invention only needs to capture the writing track of a specific color, has high efficiency, saves cost, is convenient to carry, and does not need to judge the start and end of writing.

Description

technical field [0001] The invention relates to the technical field of machine vision recognition, in particular to a system and method for handwriting recognition in the air based on machine vision. Background technique [0002] As a comfortable and natural new means of human-computer interaction, air handwriting is different from traditional human-computer interaction methods. Air handwriting allows users to write in the air in a natural and unrestrained way, which provides a more intuitive, convenient and comfortable interactive experience . The whole process of handwriting in the air mainly includes two aspects of technology. That is, dynamic target object capture and handwriting recognition. As a new type of human-computer interaction, aerial handwriting opens a new era of advanced and natural human-computer interaction, and is expected to play an important role in future human-computer interaction applications. At present, handwriting recognition in the air is mostl...

AI Technical Summary

Problems solved by technology

If there is a pause during the writing process, there will be too much noise data, so it will not be possible to achieve a truly comfortable, cheap, and natural human-computer interaction

[0004] 2. Generally, the requirements for environmental scenarios are relatively strict, requiring users to wear specific data gloves or sensing devices, and need to be equipped with position tracking locators, which makes the system expensive, low in practicability, and difficult to promote

[0005] 3. The non-contact design requires real-time monitoring of specific targets, so there are certain limitations

[0006] 4. Writing in the air is not supported by a plane like a handwriting board, it is carried out in a three-dimensional space

Therefore, the overlap between strokes and the font ratio imbalance make the recognition difficulty greatly increased

[0007] 5. The accuracy and speed of recognition cannot meet people's needs

Images