An online handwritten formula recognition method and device based on user feedback information

A technology of feedback information and formula recognition, which is applied in the direction of character and pattern recognition, character recognition, neural learning methods, etc., to achieve the effect of improving the recognition rate of formulas

Active Publication Date: 2022-05-27
INST OF SOFTWARE - CHINESE ACAD OF SCI +1
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] Aiming at the problems existing in the existing methods, the present invention designs an online handwritten formula recognition method and device based on user feedback information, which actively introduces human participation through a set of interactive means to make up for the gap that the algorithm cannot meet user needs, and at the same time With the help of the idea of ​​human-computer hybrid intelligence, in the different stages of the recognition algorithm (character segmentation, character recognition and structure analysis), the user feedback information is fused, and under the joint action of the interaction technology and the fusion algorithm, the design is suitable for user writing and error correction. Interactive technology to improve the accuracy of handwritten mathematical formula recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An online handwritten formula recognition method and device based on user feedback information
  • An online handwritten formula recognition method and device based on user feedback information
  • An online handwritten formula recognition method and device based on user feedback information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] In order for those skilled in the art to better understand the technical solutions in the embodiments of the present invention, and to make the objectives, features and advantages of the present invention more obvious and easy to understand, the following describes the technical core of the present invention in further detail with reference to the accompanying drawings. . It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

[0054] The online handwritten formula recognition method based on user feedback information of the present invention is particularly based on a structured three-stage recognition algorithm, such as figure 1 As shown, four interactive techniques of deletion, filling, structural movement and emptying are proposed.

[0055] 1. Obtain the parse tree with the maximum confidence

[0056] In order to avoid the problems of blur, noise, lack of stroke...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an online handwritten formula recognition method and device based on user feedback information, which introduces user participation such as deletion operation, pen-filling operation and / or structural movement operation into the existing recognition method. With the help of the idea of ​​human-computer hybrid intelligence, user feedback information is integrated in different stages of the "character segmentation-character recognition-structural analysis" recognition method, and an interactive technology suitable for user writing and error correction is designed. The invention designs an interactive means suitable for sketch recognition, which avoids various problems encountered in formula recognition methods based on image processing, and provides basic guarantees for users to modify strokes with clerical errors or ambiguities, and structural errors in formulas, etc. The effect of improving the formula recognition rate meets the needs of users.

Description

technical field [0001] The invention belongs to the technical field of software, and in particular relates to an online handwritten formula recognition method and device based on user feedback information. Background technique [0002] Since the 1950s, handwriting mathematical recognition has been an active research area in sketch recognition as a key component of many pen-based software interfaces such as physics, geometric theorem proving, and algebraic intelligent teaching systems. In recent years, with the popularity of touch screen and pen-type devices, handwritten mathematical expression recognition (HMER) has a wide range of potential applications in many fields such as education, office automation and conference systems, thus steadily attracting more and more community attention year by year , also promoted the development of software with handwriting recognition and hand-drawn interactive interfaces. [0003] Online handwritten mathematical expression recognition c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06V10/22G06V10/24G06V10/764G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V10/22G06V10/24G06V30/10G06N3/044G06F18/241
Inventor 田丰康文惠李俊峰魏培强刘杰戴国忠
Owner INST OF SOFTWARE - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products