Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Online handwritten formula recognition method and device based on user feedback information

A technology for feedback information and formula recognition, which is used in character and pattern recognition, character recognition, neural learning methods, etc.

Active Publication Date: 2021-06-08
INST OF SOFTWARE - CHINESE ACAD OF SCI +1
View PDF6 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] Aiming at the problems existing in the existing methods, the present invention designs an online handwritten formula recognition method and device based on user feedback information, which actively introduces human participation through a set of interactive means to make up for the gap that the algorithm cannot meet user needs, and at the same time With the help of the idea of ​​human-computer hybrid intelligence, in the different stages of the recognition algorithm (character segmentation, character recognition and structure analysis), the user feedback information is fused, and under the joint action of the interaction technology and the fusion algorithm, the design is suitable for user writing and error correction. Interactive technology to improve the accuracy of handwritten mathematical formula recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Online handwritten formula recognition method and device based on user feedback information
  • Online handwritten formula recognition method and device based on user feedback information
  • Online handwritten formula recognition method and device based on user feedback information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, and to make the purpose, features and advantages of the present invention more obvious and understandable, the technical core of the present invention will be further described in detail below in conjunction with the accompanying drawings . It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0054] The online handwritten formula recognition method based on user feedback information of the present invention is especially based on a structured three-stage recognition algorithm, such as figure 1 As shown, four interactive techniques of deletion, supplementary pen, structural movement and emptying are proposed.

[0055] 1. Obtain the parse tree with maximum confidence

[0056] In order to avoid blurring, noise, lack of strokes, complex bac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an online handwritten formula recognition method and device based on user feedback information. User participation such as deletion operation, pen refilling operation and / or structural movement operation is introduced into an existing recognition method. By means of the idea of man-machine mixed intelligence, user feedback information is fused in different stages of a character segmentation-character recognition-structure analysis recognition method, and an interaction technology suitable for user writing and error correction is designed. According to the method, an interaction means suitable for sketch recognition is designed, various problems encountered by a formula recognition method mainly based on image processing are avoided, basic guarantee is provided for a user to modify strokes with stroke errors or ambiguity, structural errors of formulas and the like, the effect of the formula recognition rate is improved, and the requirements of the user are met.

Description

technical field [0001] The invention belongs to the technical field of software, and in particular relates to an online handwritten formula recognition method and device based on user feedback information. Background technique [0002] Handwritten mathematics recognition, a key component of many pen-based software interfaces for physics, geometry theorem proving, and algebraic intelligence teaching systems, has been an active research area in sketch recognition since the 1950s. In recent years, with the popularity of touch screen and pen-based devices, handwritten mathematical expression recognition (HMER) has a wide range of potential applications in many fields such as education, office automation, and conference systems, and thus steadily attracts more and more community attention year by year , also promotes the development of software with handwriting recognition and hand-drawn interactive interfaces. [0003] Online handwritten mathematical expression recognition cons...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/20G06K9/32G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V10/22G06V10/24G06V30/10G06N3/044G06F18/241
Inventor 田丰康文惠李俊峰魏培强刘杰戴国忠
Owner INST OF SOFTWARE - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products