Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Offline handwritten mathematical formula recognition and reconstruction method

A mathematical formula and handwriting technology, applied in character and pattern recognition, character recognition, instruments, etc., can solve the problems of mathematical character sticking, lack of time series of offline data, and different shapes of the same character, and achieve the effect of improving the recognition effect

Pending Publication Date: 2019-07-05
UNIV OF SCI & TECH OF CHINA
View PDF7 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the arbitrariness of handwritten characters, compared with printed math characters, handwritten math characters have serious adhesion, different characters have different sizes, and the same character has different shapes, which has caused many difficulties for the segmentation and recognition of off-line handwritten math formulas.
Compared with online data, offline data lacks time series information and is more challenging in terms of formula segmentation and recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Offline handwritten mathematical formula recognition and reconstruction method
  • Offline handwritten mathematical formula recognition and reconstruction method
  • Offline handwritten mathematical formula recognition and reconstruction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0021] An embodiment of the present invention provides an off-line handwritten mathematical formula recognition and reconstruction method, such as figure 1 As shown, it mainly includes the following steps:

[0022] Step 1. Use a target detection algorithm based on deep learning to detect the position of each character in the handwritten mathematical formula image, thereby completing the segmentation of characters in the handwritten mathematical for...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an offline handwritten mathematical formula recognition and reconstruction method, which is characterized in that a character segmentation problem is converted into a target detection problem in a formula segmentation stage, so that the segmentation problem of broken characters and adhesion characters is effectively solved, and the accuracy of a character segmentation result is greatly improved; at the character recognition phase, two convolutional neural network models based on batch normalization and global average pooling methods and only using convolution kernels with the size of 3 * 3 are designed for the problem of offline handwritten mathematical character recognition, the voting results of the two models are used as recognition results in the recognition stage, so that the recognition of mathematical characters can be accurately completed, and the character recognition accuracy is improved; at the formula analysis and reconstruction stage, the geometricconstraint is carried out according to the position relation among the characters, the semantic constraint is carried out by using a two-dimensional random context-independent grammar, and finally, the characters are combined from bottom to top, so that the formula reconstruction is completed.

Description

technical field [0001] The invention relates to the technical field of image processing and pattern recognition, in particular to an off-line handwritten mathematical formula recognition method. Background technique [0002] Mathematical formulas are very common in scientific and technological documents such as textbooks and scientific papers. Unlike text lines with a one-dimensional structure, the spatial relationship between characters in mathematical formulas is complex, and there are two-dimensional structures such as up-down, left-right, upper-right, lower-right, and surround. Due to the complex structure of mathematical formulas, the process of inputting formulas into electronic documents is cumbersome and complicated, and the recognition technology of mathematical formulas can easily convert formula images or stroke sequences of handwritten formulas into editable formula formats in electronic documents. [0003] At present, mathematical formula recognition systems are...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/34G06K9/62
CPCG06V30/153G06V10/267G06V30/10G06F18/2411
Inventor 董兰芳刘汉超
Owner UNIV OF SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com